0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (12 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (41 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (152 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2369 rows)
9. All tests: durations (4532 rows)
A. Skipped: tests which was intentionally excluded from execution (5 rows)

Generated 19.10.2021 11:36
Tested: FB50.   Build: 5.0.0.259;   SS: 19.10.21 07:02:16 - 19.10.21 09:29:34;   CS: 19.10.21 09:31:59 - 19.10.21 11:34:07;
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 5.0.0.259
2021-10-19
5.0.0.257
2021-10-15
5.0.0.253
2021-10-13
5.0.0.249
2021-10-12
5.0.0.245
2021-10-10
5.0.0.244
2021-10-08
5.0.0.243
2021-10-06
5.0.0.242
2021-10-05
5.0.0.241
2021-10-03
5.0.0.240
2021-10-01
5.0.0.236
2021-09-30
5.0.0.232
2021-09-29
5.0.0.231
2021-09-28
5.0.0.229
2021-09-26
5.0.0.228
2021-09-23
5.0.0.220
2021-09-22
5.0.0.219
2021-09-20
5.0.0.218
2021-09-19
5.0.0.215
2021-09-17
5.0.0.212
2021-09-16
5.0.0.208
2021-09-15
5.0.0.202
2021-09-14
5.0.0.198
2021-09-12
5.0.0.197
2021-09-11
5.0.0.196
2021-09-10
5.0.0.193
2021-09-09
5.0.0.192
2021-09-08
5.0.0.187
2021-09-07
5.0.0.186
2021-09-04
5.0.0.181
2021-09-03
Test TITLE
1 SS P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P
Count ( DISTINCT ... ) is too slow
2 CS P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F    
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
3 SS P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F    
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
4 CS P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
5 SS P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
6 CS P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F    
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
7 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F    
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
8 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
9 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
10 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
11 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
12 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Bugcheck on queries containing WITH LOCK clause
13 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Bugcheck on queries containing WITH LOCK clause
14 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Shadow file is can not be created during restore when -use_all_space option is used
15 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Shadow file is can not be created during restore when -use_all_space option is used
16 CS P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
17 SS P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P P
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
18 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
19 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
20 CS P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
21 SS P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
22 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F    
Feature CORE-6482 - System table with keywords.
23 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F    
Feature CORE-6482 - System table with keywords.
24 SS P P P P P P     F         F     X X X X X X X X X X X X X X X X X X X X X X
Query to mon$ tables does not return data when the encryption/decryption thread is running
25 SS P P P P P P P P P P P P P P P     F     X X X X X X X X X X X X X X
Lack of proper clean up after failure to initialize shared memory
26 CS P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P
Check list of files in the current Firebird snapshot
27 SS P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P
Check list of files in the current Firebird snapshot
28 CS P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P
ISQL - SHOW DATABASE
29 SS P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P
ISQL - SHOW DATABASE
30 CS P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F    
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
31 SS P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F    
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
32 CS P P P P     F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
33 SS P P P P     F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
34 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
35 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
36 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability to run complex query
37 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability to run complex query
38 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
39 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
40 CS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
gbak utility: check ability to use -ZIP command switch when create backup
41 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
gbak utility: check ability to use -ZIP command switch when create backup

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.259
2021-10-19
5.0.0.257
2021-10-15
5.0.0.253
2021-10-13
5.0.0.249
2021-10-12
5.0.0.245
2021-10-10
5.0.0.244
2021-10-08
5.0.0.243
2021-10-06
5.0.0.242
2021-10-05
5.0.0.241
2021-10-03
5.0.0.240
2021-10-01
5.0.0.236
2021-09-30
5.0.0.232
2021-09-29
5.0.0.231
2021-09-28
5.0.0.229
2021-09-26
5.0.0.228
2021-09-23
5.0.0.220
2021-09-22
5.0.0.219
2021-09-20
5.0.0.218
2021-09-19
5.0.0.215
2021-09-17
5.0.0.212
2021-09-16
5.0.0.208
2021-09-15
5.0.0.202
2021-09-14
5.0.0.198
2021-09-12
5.0.0.197
2021-09-11
5.0.0.196
2021-09-10
5.0.0.193
2021-09-09
5.0.0.192
2021-09-08
5.0.0.187
2021-09-07
5.0.0.186
2021-09-04
5.0.0.181
2021-09-03
Test TITLE
1 SS 6100 6080 6100 5940 6040 6010 6030 5980 6940 5950 5940 6070 7410 5980 6070 6130 6030 6180 6140 6170 6090 6110 6200 6170 6200 6050 6100 6150 6160 6130 6150
Count ( DISTINCT ... ) is too slow
2 CS 2080 1870 2110 2080 2070 2090 2090 2110 2070 2070 2050 2070 2070 2070 2080 2080 2070 2070 2070 2080 2120 2110 2100 2070 2090 2090 2080 2090 2110 2070 2070
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
3 SS 2370 2390 2390 2360 2420 2370 2310 2370 2360 2370 2390 2360 2360 2350 2370 2350 2370 2420 2380 2370 2370 2370 2380 2350 2350 2420 2370 2350 2340 2370 2350
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
4 CS 1615 1470 1620 1620 1620 1640 1650 1630 1620 1610 1630 1620 1610 1610 1600 1630 1610 1630 1610 1620 1630 1610 1600 1620 1620 1610 1610 1610 1600 1610 1610
Prohibit ability to cast timestamps that out of valid range to varchar
5 SS 1875 1900 1900 1890 1890 1930 1880 1810 1910 1910 1870 1890 2300 1890 1810 1900 1890 1890 1900 1870 1810 1820 1810 1810 1820 1850 1810 1810 1770 1810 1810
Prohibit ability to cast timestamps that out of valid range to varchar
6 CS 2100 2080 2100 2100 2140 2120 2110 2150 2080 2120 2070 2100 2060 2100 2150 2130 2090 2100 2090 2090 2110 2070 2090 2100 2110 2120 2080 2140 2090 2100 2140
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
7 SS 2370 2370 2410 2370 2420 2370 2320 2390 2400 2350 2350 2400 2350 2360 2360 2370 2380 2410 2360 2360 2390 2370 2360 2390 2330 2370 2370 2370 2340 2390 2340
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
8 CS 4640 4140 4650 4680 4620 4650 4690 4640 4640 4660 4600 4640 4550 4680 4640 4620 4640 4640 4630 4640 4630 4710 4650 4100 4000 4610 4650 4610 4540 4600 4680
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
9 SS 5380 5380 5430 5360 5410 5480 5420 5370 5350 5360 5350 5470 5390 5390 5370 5440 5460 5450 5370 5370 5380 5380 5410 4850 4760 5450 5430 5370 5380 5360 5350
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
10 CS 18380 17780 18720 18440 18860 18000 18240 18810 18000 18770 18260 18300 18770 18190 18850 18320 18640 18310 18740 18710 18690 18130 18660 15290 15770 18160 18160 18720 18800 18000 19180
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
11 SS 21785 21900 21730 21840 21770 21760 22120 21960 21700 21630 22320 21840 21790 21820 21850 21780 21410 21780 21870 21860 21860 21760 21780 18030 18210 21810 21880 21810 21720 21000 21770
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
12 CS 5820 5780 5720 5770 5990 5770 5820 5890 6030 5930 5770 5000 6000 5760 5940 5760 5890 5760 5820 5850 5860 6110 6240 5580 5720 5720 5000 6130 5960 5730 5880
Bugcheck on queries containing WITH LOCK clause
13 SS 6100 6200 6270 6130 6080 6200 6120 6100 6100 6100 6050 6120 6100 6100 6080 6110 6060 6140 6100 6110 6220 6090 6130 5700 5760 6160 6070 6070 6080 6200 6170
Bugcheck on queries containing WITH LOCK clause
14 CS 5020 4540 5000 5000 5070 5110 4960 5070 5140 5190 4990 5420 5040 4960 5150 4960 5100 4960 4930 5040 5100 4930 5090 4450 4510 4920 4930 5060 5080 4930 5070
Shadow file is can not be created during restore when -use_all_space option is used
15 SS 5800 5860 5870 5850 5860 5830 5830 5820 5770 5780 5770 5800 5800 5790 5850 5810 5670 5800 5820 5760 5810 5830 5790 5260 5240 5800 5800 5860 5820 5800 5770
Shadow file is can not be created during restore when -use_all_space option is used
16 CS 3720 3570 3700 3720 3760 3790 3720 3780 3730 3700 3740 3710 3710 3700 3760 3730 3740 3000 3710 3810 3730 3700 3000 3690 4070 3700 3720 3730 3730 3720 3720
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
17 SS 4025 4040 4110 4140 3980 4110 4010 4080 3980 4010 4020 4040 4060 4010 4000 4060 3960 3990 4000 4050 4040 4080 4050 4040 4070 4030 4000 3990 3980 3980 3990
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
18 CS 5470 5150 5460 5400 5460 5430 5490 5550 5480 5590 5410 5530 5460 5430 5480 5420 5520 5530 5520 6060 5440 5490 5370 4990 4980 5480 5550 5430 5460 5490 5490
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
19 SS 5690 5710 5680 5690 5680 5830 5710 5690 5670 5700 5800 5670 5660 5710 5710 5740 5730 5690 5660 5700 5690 5630 5000 5190 5190 5570 5680 5680 5730 5690 5690
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
20 CS 1615 1000 1660 1620 1620 1610 1630 1630 1620 1620 1610 1610 1640 1590 1620 1590 1590 1590 1600 1630 1650 1590 1650 1590 1600 1620 1620 1620 1600 1610 1610
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
21 SS 1810 1840 1780 1810 1810 1800 1860 1790 1830 1810 1830 1850 1790 1800 1800 1810 1800 1810 1830 1800 1830 1790 1820 1810 1820 1810 1810 1810 1810 1790 1810
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
22 CS 1620 1480 1620 1600 1650 1610 1620 1660 1660 1640 1590 1600 1620 1610 1630 1600 1600 1610 1620 1620 1640 1610 1640 1630 1620 1630 1600 1670 1670 1610 1640
Feature CORE-6482 - System table with keywords.
23 SS 1840 1820 1790 1840 1820 1820 1860 1790 1840 1850 1840 1860 1820 1840 1840 1810 1820 1850 1820 1810 1840 1820 1840 1840 1860 1830 1840 1840 1840 1830 1820
Feature CORE-6482 - System table with keywords.
24 SS 16945 10730 10000 10820 10000 24610 23070 26160 26720
Query to mon$ tables does not return data when the encryption/decryption thread is running
25 SS 15730 16300 15000 15430 15740 15000 16120 15740 15820 15880 15680 15620 15650 15930 15610 15720 2006310
Lack of proper clean up after failure to initialize shared memory
26 CS 1670 1560 1680 1730 1670 1670 1670 1680 1690 1670 1670 1670 1660 1670 1670 1680 1670 1670 1670 1670 1670 1670 1690 1670 1680 1690 1670 1690 1720 1660 1670
Check list of files in the current Firebird snapshot
27 SS 1920 2110 2040 1890 2070 1980 1970 1840 2060 1950 1970 1980 2110 2010 1820 1840 2180 1840 2000 2110 1830 1850 1840 1810 1970 1870 1850 1840 1850 1850 1860
Check list of files in the current Firebird snapshot
28 CS 1620 1460 1670 1650 1620 1640 1660 1620 1620 1620 1620 1660 1610 1610 1610 1620 1610 1600 1600 1630 1620 1600 1620 1600 1760 1650 1620 1590 1590 1610 1590
ISQL - SHOW DATABASE
29 SS 1840 1850 1840 1850 1820 1860 1830 1840 1790 1870 2010 1840 1830 1840 1910 1850 1820 1840 1830 1820 1820 1850 1820 1810 1860 1820 1930 1830 1840 1840 1800
ISQL - SHOW DATABASE
30 CS 2105 1910 2180 2100 2130 2100 2130 2090 2140 2090 2090 2150 2070 2090 2070 2090 2110 2150 2100 2140 2110 2110 2120 2140 2090 2070 2060 2100 2110 2110 2140
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
31 SS 2400 2420 2000 2420 2400 2400 2400 2360 2380 2380 2390 2420 2420 2410 2380 2390 2390 2420 2410 2380 2420 2400 2420 2390 2450 2380 2530 2410 2420 2400 2470
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
32 CS 1610 1470 1590 1640 1590 1670 1670 1620 1610 1630 1610 1640 1590 1600 1620 1630 1610 1610 1590 1600 1590 1590 1590 1610 1600 1620 1630 1590 1600 1590 1620
test de la fonction datediff pour avoir le resultat en minute
33 SS 1810 1810 1840 1830 1830 1790 1820 1810 1840 1810 1810 1800 1790 1810 1830 1790 1810 1830 1830 1810 1820 1830 1810 1810 1840 1810 1810 1800 1820 1810 1810
test de la fonction datediff pour avoir le resultat en minute
34 CS 4625 4490 4650 4650 4630 4650 4620 4770 4640 4000 4620 4640 4660 4600 4630 4600 4610 4600 4680 4620 4600 4600 4680 3540 3580 4600 4610 4630 4630 4650 4700
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
35 SS 5485 5560 5460 5460 5570 5480 5570 5560 5570 5460 5660 5470 5480 5410 5540 5520 5420 5450 5530 5470 5520 5480 5520 4430 4320 5420 5990 5460 5490 5650 5630
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
36 CS 6315 6020 6390 6270 6260 6350 6400 6350 6280 6350 6380 6260 6370 6260 6360 6360 6510 6270 6270 6300 6320 6310 6350 3610 3660 6290 6470 6290 6300 6380 6340
Check ability to run complex query
37 SS 7020 7100 7080 7010 7030 7070 7070 7020 7080 7020 7020 7080 6970 6950 7000 7010 7130 7050 7040 7020 6990 7050 6990 4430 4290 7030 7600 6980 6990 7000 6970
Check ability to run complex query
38 CS 23620 22000 23870 23650 23480 23560 23900 23670 24070 24020 24030 23410 23400 24100 23900 23610 23480 23370 23630 23820 23610 23920 23880 23040 23070 23590 23520 23430 23470 24050 24070
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
39 SS 24405 24870 24540 24620 24400 26360 24140 24260 24180 24420 24430 24200 24350 23940 24790 24410 24470 24510 24540 26790 24350 24310 24490 23780 24040 26740 24960 24170 24370 24190 24070
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
40 CS 10310 10550 10180 10700 9790 10190 10180 10080 11010 10730 10620 10490 11010 10410 10200 10670 10340 10220 10240 10800 9840 10740 10660 9970 10090 10000 10430 10010 10280 9990 10380
gbak utility: check ability to use -ZIP command switch when create backup
41 SS 8625 8650 8970 8630 8640 9260 8840 8570 8620 8770 8640 8550 8580 8520 8570 8720 8580 8630 8560 8570 8600 8800 8780 8180 8330 8630 8930 8480 8800 8540 8550
gbak utility: check ability to use -ZIP command switch when create backup

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-214
http://tracker.firebirdsql.org/browse/core-4774
http://tracker.firebirdsql.org/browse/core-4789
http://tracker.firebirdsql.org/browse/core-4848
http://tracker.firebirdsql.org/browse/core-4928
http://tracker.firebirdsql.org/browse/core-5538
http://tracker.firebirdsql.org/browse/core-5576
http://tracker.firebirdsql.org/browse/core-5630
http://tracker.firebirdsql.org/browse/core-5664
http://tracker.firebirdsql.org/browse/core-6377
http://tracker.firebirdsql.org/browse/core-6474
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/build/snapshot-files-check-list.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/dml/merge_02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/eqc-136030.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/eqc-306263.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/max-path-length.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/util/gbak_zip.fbt
https://github.com/FirebirdSQL/firebird/issues/310
https://github.com/FirebirdSQL/firebird/issues/6947
https://github.com/FirebirdSQL/firebird/issues/6976

=== end of list ===