0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (1 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (4 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (39 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (0 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (3852 rows)
9. All tests: durations (3877 rows)
A. Skipped: tests which was intentionally excluded from execution (2 rows)

Generated 15.10.2021 15:15
Tested: FB30.   Build: 3.0.8.33520;   SS: 15.10.21 12:41:45 - 15.10.21 13:56:41;   CS: 15.10.21 13:59:39 - 15.10.21 15:13:24;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.8.33520
2021-10-15
3.0.8.33519
2021-10-07
3.0.8.33506
2021-10-01
3.0.8.33505
2021-09-30
3.0.8.33504
2021-09-29
3.0.8.33501
2021-09-26
3.0.8.33498
2021-09-17
3.0.8.33497
2021-09-16
3.0.8.33495
2021-09-11
3.0.8.33494
2021-09-10
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-09-01
3.0.8.33489
2021-08-27
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33485
2021-07-16
3.0.8.33484
2021-07-08
3.0.8.33482
2021-07-06
3.0.8.33478
2021-07-03
3.0.8.33476
2021-06-30
3.0.8.33475
2021-06-20
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
Test TITLE
1 CS P P P P P P P X P P P P P P P P P P P     F         F         F     P P P P P P P P
Grants don't work for procedures used inside views
2 SS P P P P P P P P P P P P P P P P P P P     F         F         F     P P P P P P P P
Grants don't work for procedures used inside views
3 CS     F         F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
CREATE COLLATION connection lost under Posix
4 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
CREATE COLLATION connection lost under Posix
5 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
6 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
7 CS P P P P P P P X P P P P P     F     P P P P P P P     F         F         F     P P     F     P P P
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
8 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
Keyword SET should not be required in ALTER USER statement
9 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
Keyword SET should not be required in ALTER USER statement
10 CS P P P P P P P X P P P P P P P P P P P     F     P P P P P P P P P P
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
11 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
FB3: CREATE USER GRANT ADMIN ROLE does not work
12 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
FB3: CREATE USER GRANT ADMIN ROLE does not work
13 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
14 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
15 CS P P P     F     P P P X P P P P P P P P P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
16 SS P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
17 SS P P P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
18 CS P P P P P P P X P P P P P P P P P P     F     P     F         F     P P P P P P P P
Granting access rights to view is broken
19 SS P P P P P P P P P P P P P P P P P P     F     P     F         F     P P P P P P P P
Granting access rights to view is broken
20 CS P P P P P P     F     X P P P P P P P P P P P P P P P P P P P P P P
Bad optimization of some operations with views containing subqueries
21 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P
Bad optimization of some operations with views containing subqueries
22 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
23 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
24 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
25 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
26 CS P P P P P P P X P P P P P P P P P P P P     F         F     P P P P P P P P
Permissions for create or alter statements are not checked
27 SS P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P P P
Permissions for create or alter statements are not checked
28 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Implementation of SUBSTRING for UTF8 character set is inefficient
29 CS X X X X X X X X X X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
30 SS X X X X X X X X X X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
31 CS     F     P P P     F     P P X P P P P P P P P P X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
32 SS P P P P P P P     F     P P P P P     F     P P P X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
33 CS P P P P P P P X P P P P P P P P P P P P P P P P P     F         F     P P     F    
Getting "records fetched" for functions/procedures in trace
34 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P
Getting "records fetched" for functions/procedures in trace
35 CS     F         F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
36 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
37 CS P P P P P P P X P     F     P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE
38 CS P     F         F         F     P P P X P P P P P P P P P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
39 SS P     F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33520
2021-10-15
3.0.8.33519
2021-10-07
3.0.8.33506
2021-10-01
3.0.8.33505
2021-09-30
3.0.8.33504
2021-09-29
3.0.8.33501
2021-09-26
3.0.8.33498
2021-09-17
3.0.8.33497
2021-09-16
3.0.8.33495
2021-09-11
3.0.8.33494
2021-09-10
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-09-01
3.0.8.33489
2021-08-27
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33485
2021-07-16
3.0.8.33484
2021-07-08
3.0.8.33482
2021-07-06
3.0.8.33478
2021-07-03
3.0.8.33476
2021-06-30
3.0.8.33475
2021-06-20
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
Test TITLE
1 CS 1850 2070 1890 1950 1910 1850 1820 1830 1770 1780 1910 1810 1950 1950 1930 1880 1960 1830 1870 1800 1850 1810 1930 1840 1840 1770 1890 1830 1000 1740
Grants don't work for procedures used inside views
2 SS 1995 2170 2120 2020 1970 2030 2030 1910 2340 1890 2110 1900 1910 1950 1960 1810 2060 1850 1850 2050 1940 1890 2080 1800 2040 2080 2110 2230 2050 1930 1960
Grants don't work for procedures used inside views
3 CS 795 880 780 0 930 790 770 770 860 740 970 800 800 700 0 920 810 0 890 830 780 800 800 780 730 730 780 770 790 830
CREATE COLLATION connection lost under Posix
4 SS 790 1010 860 850 790 770 840 780 980 690 780 930 710 730 760 740 730 0 760 780 800 850 830 800 910 780 850 900 840 780 770
CREATE COLLATION connection lost under Posix
5 CS 1990 2100 2220 1880 2000 1950 1910 1940 2000 1970 2000 2280 2140 2110 2090 1970 2110 1830 1940 1880 1510 1560 1910 2120 2020 1900 1960 2420 1990 2030
Extend syntax for ALTER USER CURRENT_USER
6 SS 1905 1850 2100 2030 2020 1940 2210 1880 2470 1920 2010 1790 1860 1870 1690 1820 1940 1790 1890 2020 1900 1630 1590 1860 2090 1940 1910 1920 1970 1860 1860
Extend syntax for ALTER USER CURRENT_USER
7 CS 1060 990 1040 1060 1110 1150 1030 1140 1110 1070 1140 1000 1100 990 1020 1060 1110 1100 1160 1090 1040 1020 1160 1030 1040 1000 1030 980 1120 1060
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
8 CS 1870 1910 1910 1940 2010 1870 1970 2090 1950 1810 1830 1900 1870 1890 1890 1860 1870 1760 1800 1890 1630 1700 1980 1860 1960 1790 1850 1890 1870 1830
Keyword SET should not be required in ALTER USER statement
9 SS 1530 1580 1510 1820 1590 1570 1640 1580 2050 1610 1390 1450 1690 1510 1680 1490 1520 1440 1530 1510 1770 1410 1360 1000 1590 1540 1530 1520 1610 1530 1000
Keyword SET should not be required in ALTER USER statement
10 CS 16330 18010 16990 16920 15760 16330 16020 15490 17000 16100 16930 16620 15120 17270 16640 15860 15820 15680 15980 158080 18050 16310 16980 16610 16000 17510 15560 17430 15850 16000
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
11 CS 3230 3370 3890 2990 3620 3400 3220 3140 3540 3140 3470 3610 3400 3220 3350 3440 3100 2970 3050 3080 2980 3310 3260 2940 3060 3270 2990 3430 3080 3230
FB3: CREATE USER GRANT ADMIN ROLE does not work
12 SS 2800 2970 3120 3010 2700 3770 2850 2670 2640 2790 2880 2590 2680 3170 3700 2800 2670 2850 2650 2710 2770 2800 2860 2730 2920 2910 2970 2600 2960 2780 2680
FB3: CREATE USER GRANT ADMIN ROLE does not work
13 CS 2450 2530 2000 2720 2530 2440 2000 2740 2330 2450 2440 2600 2530 3110 2430 2440 2480 2280 2430 2350 2450 2400 2800 2380 2620 2310 2540 2600 2580 2950
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
14 SS 2110 2310 2180 2160 2080 2210 2240 2210 2710 2210 2080 2000 2050 2160 2010 2180 2200 1980 1980 2110 2070 2100 2110 1980 2190 2140 2080 2040 2400 2080 2090
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
15 CS 650 670 680 680 630 640 680 680 640 630 660 630 690 630 650 780 690 650 620 630 650 610 680 590 670 620 620 670 640 630
Prohibit ability to cast timestamps that out of valid range to varchar
16 SS 655 780 720 720 680 720 650 670 640 680 590 680 620 640 570 630 620 620 600 620 670 650 700 660 670 700 680 650 820 620 610
Prohibit ability to cast timestamps that out of valid range to varchar
17 SS 22800 25140 28230 24580 24080 24540 24210 24080 31240 22770 23330 23710 22690 22230 22730 22420 22290 22830 21990 24090 23910 23520 22720 22990 21960 21710 20060 20640 22480 20690 20110
Increase speed of creating package when number of its functions more than several hundreds
18 CS 1830 2040 1920 1580 1870 1760 1850 1770 1740 1000 1940 1610 1690 2040 1930 1760 1930 1620 1680 1730 1790 1900 1850 2030 1720 1650 1860 1830 1960 1870
Granting access rights to view is broken
19 SS 1800 1970 1880 1830 1870 1970 1700 1780 1760 1640 2030 1720 1690 1780 2040 1760 1880 1740 1670 1650 1850 1730 1820 1700 1990 1940 1690 1920 1840 2000 1770
Granting access rights to view is broken
20 CS 2470 3010 2680 2550 2580 2460 2410 2470 2460 2380 2460 2440 2670 2630 2400 2530 2920 2650 2790 2630 2420 2480 2400 2590 2270 2440 2440 2390 2480 2000
Bad optimization of some operations with views containing subqueries
21 SS 2280 3020 2110 2480 2390 2440 2320 2760 2280 2220 2860 2160 2140 2130 2310 2000 2200 2120 2110 2220 2280 2350 2000 2160 2490 2440 2000 2370 2270 2320 2480
Bad optimization of some operations with views containing subqueries
22 CS 1140 1190 1210 1120 1150 1120 1110 1270 1130 1140 1340 1140 1180 1150 1160 1140 1000 1130 990 1120 910 880 1140 1150 1210 1150 1140 1050 1120 1160
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
23 SS 1130 1330 1180 1200 1160 1130 1090 1130 1210 1150 1040 1160 1070 1050 1080 1030 1140 1100 1110 1080 1160 910 890 1100 1170 1170 1300 1090 1170 1130 1360
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
24 CS 1940 1870 1960 1890 2110 1980 1910 1920 1860 2020 1920 1900 1990 1970 1910 2110 1910 1890 2170 1860 2180 1910 2030 2010 2090 1940 2210 1800 2050 1930
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
25 SS 2000 2040 1980 2260 2070 2010 1990 2080 2400 1890 1920 1820 1870 1840 1920 1930 1890 2140 1840 2040 1980 2010 2020 2390 1950 2050 2140 1900 2130 2050 1920
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
26 CS 3780 4050 3990 3000 3850 3620 3650 3780 3820 3600 3780 3740 3810 3690 3620 4220 3600 3710 3830 3860 3740 3840 3680 4000 3940 3780 3840 3820 3700 3620
Permissions for create or alter statements are not checked
27 SS 3750 3770 3920 3660 3800 4140 3800 3970 4900 3850 3720 3540 3000 3910 4310 3590 3700 3860 3540 3910 3670 3730 3690 3660 4050 4060 3670 3610 3610 3720 3770
Permissions for create or alter statements are not checked
28 SS 1025 1080 1090 1040 1210 1090 960 1050 990 1000 1020 980 940 1000 990 1000 980 1010 950 1030 1080 1170 1020 1100 1000 1100 1090 1050 1090 1080 1000
Implementation of SUBSTRING for UTF8 character set is inefficient
29 CS 4930 4910 5060 4950 4960 4900 4990 4930 4810 4930 4980 4790 4820 4830 4970 5040 4800 5020 5010 4850 4860
Many indexed reads in a compound index with NULLs [CORE2709]
30 SS 4750 4710 4730 4710 5550 4870 4590 4000 4610 5030 4770 4870 4720 4730 5010 5090 4760 4740 4790 4650 5180
Many indexed reads in a compound index with NULLs [CORE2709]
31 CS 18675 19840 20000 20470 23590 21330 18320 18840 18510 17200 18970 17400 18880 18400 18150 18090 17800
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
32 SS 18380 20690 20070 19270 21610 20820 17960 18380 22030 17590 17670 17360 19180 17890 22150 17190 16740 18310
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
33 CS 5550 5840 5290 5550 5760 5630 5510 5460 5430 5360 5620 5490 5410 7030 5340 5570 5520 5510 5630 5460 5420 5420 5510 8670 8810 8450 8270 8570 8460 8520
Getting "records fetched" for functions/procedures in trace
34 SS 5445 5490 5370 5430 5000 5570 5240 5260 6670 5430 5420 5390 5690 5230 5340 5320 5440 5450 5440 5410 5390 5460 5460 5470 8440 8380 8310 8280 8370 8260 8430
Getting "records fetched" for functions/procedures in trace
35 CS 4430 4430 4760 4680 4600 4270 4240 4480 4390 4220 4080 4200 4550 4390 4200 4000 4430 4280 5270 4240 4140 4400 5080 4710 4600 4490 4430 4140 4770 4780
INNER JOIN join order
36 SS 4545 4880 4000 4640 4720 5020 4300 4390 4420 4390 4120 4720 4000 4400 4350 4640 4540 4300 4350 5050 4280 4550 4910 4640 4570 4650 4610 4380 4560 4550 4480
INNER JOIN join order
37 CS 650 0 0 760 670 710 650 640 650 680 770 690 630 680 550 680 640 580 640 660 670 690 710 630 640 610 670 650 580 610
ISQL - SHOW DATABASE
38 CS 640 630 670 690 740 690 640 770 640 640 640 640 710 640 670 620 660 590 640 730 590 640 580 610 610 670 620 600 640 650
test de la fonction datediff pour avoir le resultat en minute
39 SS 650 680 800 830 0 710 760 690 740 610 640 610 620 670 620 620 640 650 600 620 710 640 610 650 600 660 660 720 630 630 680
test de la fonction datediff pour avoir le resultat en minute

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-3365
http://tracker.firebirdsql.org/browse/core-3554
http://tracker.firebirdsql.org/browse/core-4326
http://tracker.firebirdsql.org/browse/core-4337
http://tracker.firebirdsql.org/browse/core-4468
http://tracker.firebirdsql.org/browse/core-4766
http://tracker.firebirdsql.org/browse/core-4789
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5279
http://tracker.firebirdsql.org/browse/core-5393
http://tracker.firebirdsql.org/browse/core-5827
http://tracker.firebirdsql.org/browse/core-5841
http://tracker.firebirdsql.org/browse/core-6078
http://tracker.firebirdsql.org/browse/core-6542
http://tracker.firebirdsql.org/browse/core-927
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/firebird/issues/3106
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6782

=== end of list ===