0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (1 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (4 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (36 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (0 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (1 rows)
8. All tests: outcomes (3851 rows)
9. All tests: durations (3875 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 26.09.2021 23:47
Tested: FB30.   Build: 3.0.8.33501;   CS: 26.09.21 22:35:04 - 26.09.21 23:44:57;   SS: 26.09.21 21:20:09 - 26.09.21 22:32:12;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.8.33501
2021-09-26
3.0.8.33498
2021-09-17
3.0.8.33497
2021-09-16
3.0.8.33495
2021-09-11
3.0.8.33494
2021-09-10
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-09-01
3.0.8.33489
2021-08-27
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33485
2021-07-16
3.0.8.33484
2021-07-08
3.0.8.33482
2021-07-06
3.0.8.33478
2021-07-03
3.0.8.33476
2021-06-30
3.0.8.33475
2021-06-20
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
3.0.8.33467
2021-05-06
3.0.8.33465
2021-05-05
3.0.8.33463
2021-05-04
3.0.8.33462
2021-05-03
3.0.8.33461
2021-05-01
Test TITLE
1 CS P P X P P P P P P P P P P P     F         F         F     P P P P P P P P P P P P P
Grants don't work for procedures used inside views
2 SS P P P P P P P P P P P P P P     F         F         F     P P P P P P P P P P P P P
Grants don't work for procedures used inside views
3 CS     F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
CREATE COLLATION connection lost under Posix
4 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
CREATE COLLATION connection lost under Posix
5 CS P P X P P P P P P P P P P P P P P P P P P P P P P P     F     P P P
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
6 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
7 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
8 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
9 CS P P X P P P P P     F     P P P P P P P     F         F         F     P P     F     P P P P P P P P
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
10 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Keyword SET should not be required in ALTER USER statement
11 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Keyword SET should not be required in ALTER USER statement
12 CS P P X P P P P P P P P P P P     F     P P P P P P P P P P P P P P P
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
13 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
FB3: CREATE USER GRANT ADMIN ROLE does not work
14 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
FB3: CREATE USER GRANT ADMIN ROLE does not work
15 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 SS P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
18 CS P P X P P P P P P P P P P     F     P     F         F     P P P P P P P P P P P P P
Granting access rights to view is broken
19 SS P P P P P P P P P P P P P     F     P     F         F     P P P P P P P P P P P P P
Granting access rights to view is broken
20 CS P     F     X P P P P P P P P P P P P P P P P P P P P P P P P P P P
Bad optimization of some operations with views containing subqueries
21 SS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
Bad optimization of some operations with views containing subqueries
22 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P X X X X X
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
23 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P X X X X X
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
24 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
25 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
26 CS P P X P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Permissions for create or alter statements are not checked
27 SS P P P P P P P P P P P P P P P     F         F     P P P P P P P P P P P P P
Permissions for create or alter statements are not checked
28 SS     F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F    
Implementation of SUBSTRING for UTF8 character set is inefficient
29 CS X X X X X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X
Many indexed reads in a compound index with NULLs [CORE2709]
30 SS X X X X X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X
Many indexed reads in a compound index with NULLs [CORE2709]
31 SS P P     F     P P P P P     F     P P P X X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
32 CS P P X P P P P P P P P P P P P P P P P P     F         F     P P     F     P P P P P
Getting "records fetched" for functions/procedures in trace
33 SS P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P
Getting "records fetched" for functions/procedures in trace
34 CS     F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
35 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
36 CS P P X P     F     P P P P P P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33501
2021-09-26
3.0.8.33498
2021-09-17
3.0.8.33497
2021-09-16
3.0.8.33495
2021-09-11
3.0.8.33494
2021-09-10
3.0.8.33493
2021-09-08
3.0.8.33492
2021-09-07
3.0.8.33491
2021-09-04
3.0.8.33490
2021-09-01
3.0.8.33489
2021-08-27
3.0.8.33488
2021-08-14
3.0.8.33487
2021-08-07
3.0.8.33486
2021-07-20
3.0.8.33485
2021-07-16
3.0.8.33484
2021-07-08
3.0.8.33482
2021-07-06
3.0.8.33478
2021-07-03
3.0.8.33476
2021-06-30
3.0.8.33475
2021-06-20
3.0.8.33474
2021-06-16
3.0.8.33473
2021-06-12
3.0.8.33472
2021-06-09
3.0.8.33471
2021-06-02
3.0.8.33470
2021-06-01
3.0.8.33468
2021-05-29
3.0.8.33467
2021-05-06
3.0.8.33465
2021-05-05
3.0.8.33463
2021-05-04
3.0.8.33462
2021-05-03
3.0.8.33461
2021-05-01
Test TITLE
1 CS 1849 1819 1829 1769 1779 1910 1809 1950 1950 1930 1880 1960 1830 1869 1799 1849 1809 1930 1839 1839 1770 1890 1829 1000 1740 2370 2400 2359 2629 2410
Grants don't work for procedures used inside views
2 SS 2034 2029 1910 2339 1889 2109 1900 1910 1950 1960 1810 2059 1849 1849 2049 1940 1890 2079 1799 2039 2080 2109 2230 2049 1930 1960 2509 2410 2399 2380 2400
Grants don't work for procedures used inside views
3 CS 799 769 769 860 740 970 800 799 700 0 920 810 0 890 829 779 799 799 779 730 730 779 770 789 829 1070 1059 1029 1089 1029
CREATE COLLATION connection lost under Posix
4 SS 800 839 780 980 690 779 929 710 730 759 740 730 0 759 779 799 849 829 800 910 780 849 900 839 779 769 1109 1009 1099 1039 990
CREATE COLLATION connection lost under Posix
5 CS 3580 3620 4079 3539 3529 3650 3549 3559 3539 3650 3569 3529 3509 3610 3619 3630 3490 3569 3440 3470 3549 3779 3700 3580 3480 4029 4099 3830 4019 4150
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
6 SS 3519 3799 3569 3420 3390 3549 3510 3580 3410 3690 3519 3400 3410 3390 3579 3460 3449 3439 3460 3549 3539 3490 3399 3630 3520 3480 4150 4050 3880 4089 4029
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
7 CS 2000 1910 1939 2000 1970 2000 2279 2140 2110 2089 1970 2109 1829 1940 1880 1509 1559 1909 2119 2019 1900 1960 2420 1990 2029 2690 2549 2609 2569 2690
Extend syntax for ALTER USER CURRENT_USER
8 SS 1914 2210 1880 2470 1920 2009 1789 1860 1869 1689 1819 1940 1790 1889 2019 1899 1630 1590 1859 2089 1940 1909 1920 1970 1860 1860 2549 2470 2549 2509 2519
Extend syntax for ALTER USER CURRENT_USER
9 CS 1089 1029 1139 1109 1069 1140 1000 1099 990 1019 1059 1109 1100 1160 1089 1039 1019 1160 1029 1039 1000 1029 980 1119 1059 1470 1410 1490 1400 1480
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
10 CS 1889 1970 2089 1950 1810 1830 1900 1870 1890 1889 1859 1869 1759 1799 1890 1630 1700 1980 1859 1960 1789 1849 1889 1870 1830 2569 2450 2610 2480 2470
Keyword SET should not be required in ALTER USER statement
11 SS 1534 1640 1579 2049 1610 1389 1449 1690 1509 1680 1490 1519 1440 1529 1509 1769 1409 1359 1000 1589 1539 1529 1519 1609 1529 1000 2079 2119 2089 2079 2109
Keyword SET should not be required in ALTER USER statement
12 CS 16619 16019 15490 17000 16100 16930 16619 15120 17270 16640 15859 15820 15680 15980 158079 18049 16309 16980 16609 16000 17509 15559 17430 15850 16000 17870 18940 18869 18649 17919
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
13 CS 3259 3220 3139 3539 3139 3470 3610 3399 3219 3349 3440 3099 2970 3049 3079 2980 3309 3259 2940 3060 3269 2990 3430 3079 3230 4150 4140 4099 4089 4039
FB3: CREATE USER GRANT ADMIN ROLE does not work
14 SS 2824 2849 2670 2640 2789 2879 2589 2679 3169 3700 2799 2670 2850 2649 2710 2769 2800 2859 2730 2920 2909 2970 2599 2960 2779 2680 3569 3630 3550 3720 3649
FB3: CREATE USER GRANT ADMIN ROLE does not work
15 CS 2529 2000 2740 2329 2450 2440 2600 2529 3109 2429 2440 2480 2280 2430 2350 2449 2400 2799 2380 2620 2309 2539 2599 2580 2949 3259 3259 3109 3289 3049
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS 2124 2240 2210 2710 2210 2079 2000 2049 2160 2009 2180 2200 1979 1980 2109 2070 2100 2109 1980 2189 2139 2080 2039 2400 2079 2090 2679 2810 2940 2980 2859
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 SS 22799 24210 24079 31240 22769 23330 23710 22689 22230 22730 22420 22289 22829 21990 24089 23910 23519 22720 22989 21960 21710 20059 20639 22480 20690 20110 25890 28149 25129 25579 25210
Increase speed of creating package when number of its functions more than several hundreds
18 CS 1849 1849 1769 1740 1000 1940 1609 1690 2039 1930 1759 1930 1619 1680 1730 1789 1899 1849 2029 1720 1649 1859 1829 1959 1870 2360 2470 2149 2279 2269
Granting access rights to view is broken
19 SS 1799 1700 1779 1759 1640 2029 1720 1690 1780 2039 1759 1880 1740 1669 1649 1849 1730 1819 1700 1990 1940 1689 1919 1840 2000 1770 2140 2190 2309 2329 2180
Granting access rights to view is broken
20 CS 2480 2409 2470 2460 2380 2460 2440 2670 2629 2400 2529 2920 2649 2790 2629 2420 2480 2400 2589 2269 2440 2440 2389 2480 2000 3169 3000 3380 3100 3090
Bad optimization of some operations with views containing subqueries
21 SS 2294 2319 2759 2279 2220 2860 2160 2140 2130 2309 2000 2200 2119 2110 2220 2279 2349 2000 2159 2490 2439 2000 2370 2269 2319 2480 3119 2890 2910 2759 2789
Bad optimization of some operations with views containing subqueries
22 CS 1139 1110 1269 1129 1140 1339 1139 1180 1150 1159 1140 1000 1129 990 1120 909 879 1139 1150 1210 1150 1139 1049 1119 1159
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
23 SS 1109 1089 1129 1210 1149 1039 1160 1069 1050 1080 1029 1140 1099 1109 1079 1160 910 889 1100 1170 1170 1299 1090 1169 1129 1359
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
24 CS 1990 1909 1920 1860 2019 1920 1900 1990 1970 1910 2110 1909 1890 2170 1859 2179 1909 2029 2009 2089 1940 2210 1799 2049 1930 2519 2390 2480 2759 2420
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
25 SS 2004 1990 2080 2399 1890 1919 1820 1870 1839 1919 1930 1890 2139 1839 2039 1980 2009 2019 2390 1950 2049 2140 1899 2130 2050 1920 2350 2660 2430 2000 2450
No permission for SELECT access to BLOB field if a TABLE is accessed using VIEW
26 CS 3809 3650 3779 3819 3599 3779 3740 3809 3690 3619 4220 3600 3710 3829 3859 3740 3840 3680 4000 3940 3779 3839 3819 3700 3620 4509 4240 4490 4519 4519
Permissions for create or alter statements are not checked
27 SS 3784 3799 3970 4899 3849 3720 3539 3000 3910 4309 3589 3700 3859 3539 3909 3670 3730 3690 3660 4049 4059 3670 3609 3609 3720 3769 4970 4559 4690 4459 4240
Permissions for create or alter statements are not checked
28 SS 1024 960 1049 990 1000 1019 980 940 1000 990 1000 980 1009 950 1029 1079 1170 1019 1100 1000 1100 1090 1049 1090 1079 1000 1340 1399 1409 1450 1370
Implementation of SUBSTRING for UTF8 character set is inefficient
29 CS 4940 4910 5059 4950 4959 4899 4990 4930 4809 4930 4979 4789 4820 4829 4970 5039 4799 5019 5009 4850 4860 5460 5529
Many indexed reads in a compound index with NULLs [CORE2709]
30 SS 4764 4710 4730 4709 5550 4870 4589 4000 4610 5029 4769 4870 4720 4730 5009 5090 4759 4740 4789 4649 5180 5279 5330
Many indexed reads in a compound index with NULLs [CORE2709]
31 SS 17924 17959 18380 22029 17590 17670 17359 19180 17889 22150 17190 16740 18309
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
32 CS 5620 5509 5460 5430 5360 5620 5490 5410 7029 5340 5569 5519 5510 5629 5459 5420 5420 5509 8669 8809 8450 8270 8570 8460 8520 9129 8789 9140 9339 9179
Getting "records fetched" for functions/procedures in trace
33 SS 5465 5240 5259 6670 5430 5419 5390 5689 5230 5339 5320 5439 5449 5439 5410 5389 5460 5459 5470 8440 8380 8309 8279 8370 8259 8429 9009 8910 8740 8819 8740
Getting "records fetched" for functions/procedures in trace
34 CS 4430 4240 4479 4390 4220 4079 4200 4549 4389 4200 4000 4429 4279 5269 4240 4139 4400 5079 4710 4599 4490 4430 4139 4769 4779 5470 5649 5389 5829 5529
INNER JOIN join order
35 SS 4549 4299 4389 4420 4390 4120 4720 4000 4400 4350 4639 4539 4299 4349 5049 4280 4549 4910 4639 4570 4650 4610 4380 4559 4549 4480 5000 5319 5549 5530 5599
INNER JOIN join order
36 CS 659 649 639 650 679 769 689 630 680 549 679 639 580 640 659 669 690 709 630 640 609 669 649 580 610 900 889 920 879 829
ISQL - SHOW DATABASE

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-2531
http://tracker.firebirdsql.org/browse/core-3365
http://tracker.firebirdsql.org/browse/core-3554
http://tracker.firebirdsql.org/browse/core-4326
http://tracker.firebirdsql.org/browse/core-4337
http://tracker.firebirdsql.org/browse/core-4468
http://tracker.firebirdsql.org/browse/core-4766
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5279
http://tracker.firebirdsql.org/browse/core-5393
http://tracker.firebirdsql.org/browse/core-5827
http://tracker.firebirdsql.org/browse/core-5841
http://tracker.firebirdsql.org/browse/core-6078
http://tracker.firebirdsql.org/browse/core-6542
http://tracker.firebirdsql.org/browse/core-927
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/firebird/issues/3106
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6782

=== end of list ===