0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (1 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (1 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (32 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (497 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2215 rows)
8. All tests: outcomes (4450 rows)
9. All tests: durations (4459 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 15.10.2021 12:37
Tested: FB40.   Build: 4.0.1.2631;   CS: 15.10.21 11:00:21 - 15.10.21 12:33:49;   SS: 15.10.21 09:24:10 - 15.10.21 10:57:20;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 4.0.1.2631
2021-10-15
4.0.1.2628
2021-10-12
4.0.1.2625
2021-10-10
4.0.1.2624
2021-10-07
4.0.1.2623
2021-10-06
4.0.1.2622
2021-10-03
4.0.1.2621
2021-10-01
4.0.1.2619
2021-09-30
4.0.1.2618
2021-09-26
4.0.1.2613
2021-09-21
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-16
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-29
4.0.1.2573
2021-08-27
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
Test TITLE
1 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Privileges of dynamic statements in SP
2 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Grants don't work for procedures used inside views
3 SS P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Can't create table using long username and UTF8 as attachment charset
5 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
6 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Recursive stored procedure shouldnt require execute right to call itself
7 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Ability to cancel waiting in lock manager
8 SS P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
9 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
10 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Extend syntax for ALTER USER CURRENT_USER
11 CS P X P P P P P P P P     F     P P P     F     P P P P P P P     F     P X P P P P P
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
12 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
with caller privileges option do not work with autonomous transaction option
13 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
role not passed on external execute stmt
14 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Duplicate tags for CREATE/ALTER USER not handled correctly
15 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
SEC$ tables and tag/attributes
18 CS P X P P P P P     F     P P P P P P P P P P P P P P P P X P P P P P
Performance regression when bulk inserting into table with indices
19 SS     F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Parse error when compiling a statement causes memory leak until attachment is disconnected
20 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
21 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
error read permission for BLOB field, when it is input/output procedure`s parametr
22 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
USING PLUGIN clause does not work in RECREATE USER
23 CS     F     X P P P P P P P P P P P P P P P P P P P P P P X P P P P P
Implementation of SUBSTRING for UTF8 character set is inefficient
24 SS P P P     F     P P P P P P P P P     E     P P P P P P P P P P P P P P P P
Implementation of SUBSTRING for UTF8 character set is inefficient
25 CS P X P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
26 CS P X P P P P P P P P P P     F         F     P P P P P P P P P P X P P P P P
ISQL - SHOW DATABASE
27 SS P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE
28 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
GTCS/tests/CF_ISQL_34. minimum-grant-test
29 CS P X     F         F         F         F         F     P P P P P P P P P P P P P P P P P X P P P P P
test de la fonction datediff pour avoir le resultat en minute
30 SS P P     F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
31 CS P X P P P P P P P P P P P     F     P P P P P P P P P P X P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
32 SS P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.1.2631
2021-10-15
4.0.1.2628
2021-10-12
4.0.1.2625
2021-10-10
4.0.1.2624
2021-10-07
4.0.1.2623
2021-10-06
4.0.1.2622
2021-10-03
4.0.1.2621
2021-10-01
4.0.1.2619
2021-09-30
4.0.1.2618
2021-09-26
4.0.1.2613
2021-09-21
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-16
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-29
4.0.1.2573
2021-08-27
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
Test TITLE
1 CS 2295 2380 2340 2180 2270 2400 2780 2280 2360 2410 2270 2230 2260 910 2220 2230 2390 2310 2350 2180 2380 2620 2170 2350 2340 2410 2140 2190 2140
Privileges of dynamic statements in SP
2 CS 1970 2050 2120 2000 2020 1880 1960 2090 2080 1940 1830 2080 2040 1060 1820 1930 1970 1890 1970 2150 1860 1860 1880 2090 2070 1890 2010 1900 2010
Grants don't work for procedures used inside views
3 SS 2365 2890 2320 2660 2590 2320 2650 2550 2420 2370 2270 2470 2370 2000 70 2380 2260 2360 2550 2530 2150 2300 2000 2270 2200 2460 2320 2280 2330 2380 2530
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS 1575 1520 1520 1490 1600 1670 1720 1480 1700 1580 1680 1590 1580 1190 1530 1560 1660 1480 1570 1480 1510 1640 1550 1660 1650 1520 1680 1590 1560
Can't create table using long username and UTF8 as attachment charset
5 CS 1370 1400 1560 1470 1340 1320 1420 1370 1370 1310 1420 1430 1380 1220 1290 1450 1380 1000 1190 1450 1390 1350 1330 1370 1310 1270 1450 1330 1000
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
6 CS 2450 2550 2400 2550 2390 2440 2490 2380 2380 2430 2410 2520 2530 1010 2470 2610 2330 2410 2550 2290 2290 2460 2320 2460 2470 2670 2410 2710 2480
Recursive stored procedure shouldnt require execute right to call itself
7 CS 2430 2380 2330 2550 2440 2540 2420 2660 2530 2000 2550 2360 2920 17030 2340 2470 2160 2330 2530 2370 2260 2870 2350 2320 2530 2370 2300 2480 2470
Ability to cancel waiting in lock manager
8 SS 3080 3140 3350 3170 3220 3000 2400 3560 3380 3170 3420 3000 3290 3230 17320 3310 3210 2110 2120 2120 2150 2120 3180 2030 2100 2170 2240 3020 2190 2110 3220
Ability to cancel waiting in lock manager
9 CS 1820 1820 1800 1870 1730 1710 2590 1840 1850 1820 1860 1760 1920 1260 1890 1730 1780 1810 1700 1000 2160 1800 1950 1690 1720 2000 1840 1860 1850
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
10 CS 2190 2460 2450 2160 2180 2200 2310 2210 2150 2000 2270 2450 2280 970 2150 2270 2040 2010 2130 2200 2410 2300 2090 2300 2160 2120 2130 2140 2230
Extend syntax for ALTER USER CURRENT_USER
11 CS 1145 1260 1100 1130 1100 1210 1080 1120 1210 1050 1140 1140 1170 1160 1090 1230 1080 1200 1100 1090 1210 1130 1060 1150 1210 1160 1150 1210 1190
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
12 CS 1865 1870 1870 2160 1960 1990 1800 2400 1740 1940 2130 1890 2080 990 1870 1900 1860 1860 1830 1860 1680 2360 1760 1780 1910 1780 1860 1730 1850
with caller privileges option do not work with autonomous transaction option
13 CS 1735 1670 1780 1760 1620 1790 1860 2050 1640 1880 1000 1820 1880 960 1710 1720 1710 1730 1000 1730 1620 1780 1720 1860 1660 1840 1740 1760 1740
role not passed on external execute stmt
14 CS 1540 2030 1460 1640 1450 1590 1640 1620 1540 1560 1690 1560 1610 810 1530 1780 1670 1440 1510 1770 1470 1540 1630 1000 1380 1460 1490 1480 1000
Duplicate tags for CREATE/ALTER USER not handled correctly
15 CS 1765 1790 1970 1700 1790 1820 1730 1760 1790 1880 1710 1780 1770 1670 1940 1720 1720 1820 1000 1740 1810 1780 1660 1690 1000 1730 1000 1850 1970
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS 1340 1270 1430 1330 1350 1450 1410 1380 1510 1230 1510 1410 1460 1370 1420 1290 1380 1240 1640 1320 1290 1370 1290 1310 1300 1280 1000 1190 1300 1540 1320
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 CS 1160 1240 1470 1120 1270 1090 1180 1160 1100 1490 1270 1160 1220 830 1130 1330 1160 1000 1140 1210 1110 1140 1270 1330 1310 1400 1100 1110 1130
SEC$ tables and tag/attributes
18 CS 16085 15960 19620 15940 17060 15840 16340 16660 16120 17070 17940 16400 16620 16440 15680 15040 15660 18960 16470 16120 15710 15100 16050 16300 16000 15460 15160 15420 15640
Performance regression when bulk inserting into table with indices
19 SS 4505 4640 3990 4580 4570 4470 4350 4680 4420 4610 4360 4540 4300 4570 4630 4810 4270 4380 4600 4600 4130 4620 4470 4390 4560 4000 4160 4420 3950 4770 5120
Parse error when compiling a statement causes memory leak until attachment is disconnected
20 CS 1290 1480 1350 1880 1240 1170 1200 1430 1280 1380 1410 1360 1270 860 1200 1210 1310 1220 1290 1290 1170 1220 1420 1400 1370 1410 1450 1240 1230
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
21 CS 2090 2060 2080 2170 2330 2460 2070 2170 2330 2280 2100 2070 2200 1050 1970 2400 2020 2090 2000 2200 2150 2240 1890 2090 2180 2070 2040 1980 2050
error read permission for BLOB field, when it is input/output procedure`s parametr
22 CS 1380 1380 1390 1380 1000 1280 1390 1580 1370 1640 1380 1390 1530 970 1420 1340 1350 1410 1580 1370 1360 1490 1310 1320 1360 1620 1540 1360 1310
USING PLUGIN clause does not work in RECREATE USER
23 CS 1095 1070 1110 1170 1080 1040 1010 1240 1130 1170 1110 1130 1200 1260 1020 1170 1040 1180 1180 1010 1010 1010 1040 980 1060 1220 1020 970 1130
Implementation of SUBSTRING for UTF8 character set is inefficient
24 SS 1050 1100 1050 1160 1170 1240 1050 1160 1100 990 1110 1020 1050 1070 0 1120 970 1010 990 1010 1030 1040 1050 1110 1000 980 1000 960 1090 970 980
Implementation of SUBSTRING for UTF8 character set is inefficient
25 CS 3555 3550 3610 4380 3550 3470 3960 3560 3460 3780 3730 3660 3620 3630 3460 3790 3230 3510 3440 3560 3470 3550 3390
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
26 CS 700 710 690 710 700 700 650 730 710 680 700 760 700 690 720 730 670 670 740 690 700 680 690 0 690 910 710 660 730
ISQL - SHOW DATABASE
27 SS 695 740 770 850 770 0 830 690 840 710 710 690 700 720 730 710 620 680 640 640 740 630 0 670 630 640 680 620 730 650 630
ISQL - SHOW DATABASE
28 CS 1785 1770 1740 1720 2000 1810 1780 1950 1000 2180 1630 1860 1760 1140 1840 1760 1650 1800 1680 1920 1770 1980 1790 1920 1810 2100 1860 1710 1680
GTCS/tests/CF_ISQL_34. minimum-grant-test
29 CS 710 780 880 700 710 710 730 660 690 730 720 710 640 950 680 710 670 660 700 700 790 870 930 670 730 680 710 720 690
test de la fonction datediff pour avoir le resultat en minute
30 SS 655 630 700 690 730 720 680 790 670 740 800 640 620 670 660 770 570 640 620 630 650 640 660 600 640 650 770 650 820 650 610
test de la fonction datediff pour avoir le resultat en minute
31 CS 4105 4380 3970 4240 4000 3960 3840 4610 4110 5560 4130 5120 4360 1950 3810 4730 4100 3800 3920 4310 3980 3870 3920 4400 4480 4920 4080 4060 4270
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
32 SS 3845 3880 4120 3920 3910 3930 3950 3840 3890 4070 3780 3850 3810 3890 1310 3930 3700 3930 3700 3930 3870 3650 3850 3670 3840 3800 3770 3570 3740 3710 3800
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1291
http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-2729
http://tracker.firebirdsql.org/browse/core-3242
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-3360
http://tracker.firebirdsql.org/browse/core-3365
http://tracker.firebirdsql.org/browse/core-3554
http://tracker.firebirdsql.org/browse/core-3799
http://tracker.firebirdsql.org/browse/core-4054
http://tracker.firebirdsql.org/browse/core-4464
http://tracker.firebirdsql.org/browse/core-4766
http://tracker.firebirdsql.org/browse/core-5162
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5646
http://tracker.firebirdsql.org/browse/core-5827
http://tracker.firebirdsql.org/browse/core-5982
http://tracker.firebirdsql.org/browse/core-6083
http://tracker.firebirdsql.org/browse/core-6542
http://tracker.firebirdsql.org/browse/core-805
http://tracker.firebirdsql.org/browse/core-927
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/minimum-grant-test.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/dml-privileges-sufficiency.fbt
https://github.com/FirebirdSQL/firebird/issues/6935

=== end of list ===