0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (3 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (43 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (154 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (4470 rows)
9. All tests: durations (4473 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 19.10.2021 09:34
Tested: FB50.   Build: 5.0.0.259;   SS: 19.10.21 06:20:57 - 19.10.21 07:54:31;   CS: 19.10.21 07:57:21 - 19.10.21 09:31:36;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 5.0.0.259
2021-10-19
5.0.0.257
2021-10-15
5.0.0.253
2021-10-13
5.0.0.249
2021-10-12
5.0.0.245
2021-10-10
5.0.0.244
2021-10-08
5.0.0.243
2021-10-06
5.0.0.242
2021-10-05
5.0.0.241
2021-10-03
5.0.0.240
2021-10-01
5.0.0.236
2021-09-30
5.0.0.232
2021-09-29
5.0.0.231
2021-09-28
5.0.0.229
2021-09-26
5.0.0.228
2021-09-23
5.0.0.220
2021-09-23
5.0.0.219
2021-09-20
5.0.0.218
2021-09-19
5.0.0.215
2021-09-17
5.0.0.212
2021-09-16
5.0.0.208
2021-09-16
5.0.0.202
2021-09-14
5.0.0.198
2021-09-12
5.0.0.197
2021-09-11
5.0.0.196
2021-09-10
5.0.0.193
2021-09-09
5.0.0.192
2021-09-08
5.0.0.187
2021-09-07
5.0.0.186
2021-09-04
5.0.0.181
2021-09-03
Test TITLE
1 CS P P P P P     F     P P     F     P P P P P P X P P P P P     F     P P P     F     P P P P
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
2 CS P P P P P P P P P P P P P P P X P P P P P P P P     F         F         F         F         F         F    
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
3 SS P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F    
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
4 CS P P P P P P P P P P     F     P P P P X P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
5 SS P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P
Prohibit ability to cast timestamps that out of valid range to varchar
6 CS P P P P P P P P P P P P P P P X P P P P P P P P P P     F         F         F         F    
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
7 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F    
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
8 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
9 SS P P P P P P P P P P P P P P P U P P P P P P     F         F     P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
10 CS P P P P P P P P P P P P P P P X P P P P P P     F     P P P P P P P
ISQL 'SHOW DATABASE' command does not show encryption status of database
11 CS P     F         F     P P P P P P P P P P P P X P P P P P P P P P P P P P P
Performance regression when bulk inserting into table with indices
12 CS P P P P     F     P     F     P P P P P P P P X P P P P P P P P P P P     F     P P
Bad optimization of some operations with views containing subqueries
13 SS P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Bad optimization of some operations with views containing subqueries
14 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
15 SS P P P P P P P P P P P P P P P U P P P P P P     F         F     P P P P P P
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
16 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
Bugcheck on queries containing WITH LOCK clause
17 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Bugcheck on queries containing WITH LOCK clause
18 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
Shadow file is can not be created during restore when -use_all_space option is used
19 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Shadow file is can not be created during restore when -use_all_space option is used
20 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Parse error when compiling a statement causes memory leak until attachment is disconnected
21 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
22 SS P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P P P
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
23 CS P P P     F     P P P P P P P P P P P X P P P P P P P P P P P P P P
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
24 SS P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
25 CS P P P P P     F     P P P P P P P P P X P P P P P P P P P P P P P P
Implementation of SUBSTRING for UTF8 character set is inefficient
26 CS P P P P P P P P P P P P P P P X P P P P P P P P P P P P P     F    
Feature CORE-6482 - System table with keywords.
27 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F    
Feature CORE-6482 - System table with keywords.
28 CS P P     F     P P P     F     P P P P P P P P X P P P P P P P P P P P P P P
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
29 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
30 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
31 SS P P P P P P     F     P X X X X X X X X X X X X X X X X X X X X X X
Query to mon$ tables does not return data when the encryption/decryption thread is running
32 CS P P P P P P P P P P P P P P P X P P P P P P P P     F     P P P P P
ISQL - SHOW DATABASE
33 SS P P P P P P P P P P P P P P P U P P P P P P P P     F     P P P P P
ISQL - SHOW DATABASE
34 CS P P P P P P P P P P P P P P P X P P P P P P P P     F         F         F         F         F         F    
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
35 SS P P P P P P P P P P P P P P P U P P P P P P P P     F         F         F         F         F         F    
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
36 CS P P P P     F         F         F         F         F         F         F     P P P P X P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
37 SS P P P P     F         F         F         F         F         F         F     P P P P U P P P P P P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
38 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
39 SS P P P P P P P P P P P P P P P U P P P P P P     F         F     P P P P P P
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
40 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
Check ability to run complex query
41 SS P P P P P P P P P P P P P P P U P P P P P P     F         F     P P P P P P
Check ability to run complex query
42 CS P P P P P P P P P P P P P P P X P P P P P P     F         F     P P P P P P
gbak utility: check ability to use -ZIP command switch when create backup
43 SS P P P P P P P P P P P P P P P U P P P P P P     F         F     P P P P P P
gbak utility: check ability to use -ZIP command switch when create backup

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.259
2021-10-19
5.0.0.257
2021-10-15
5.0.0.253
2021-10-13
5.0.0.249
2021-10-12
5.0.0.245
2021-10-10
5.0.0.244
2021-10-08
5.0.0.243
2021-10-06
5.0.0.242
2021-10-05
5.0.0.241
2021-10-03
5.0.0.240
2021-10-01
5.0.0.236
2021-09-30
5.0.0.232
2021-09-29
5.0.0.231
2021-09-28
5.0.0.229
2021-09-26
5.0.0.228
2021-09-23
5.0.0.220
2021-09-23
5.0.0.219
2021-09-20
5.0.0.218
2021-09-19
5.0.0.215
2021-09-17
5.0.0.212
2021-09-16
5.0.0.208
2021-09-16
5.0.0.202
2021-09-14
5.0.0.198
2021-09-12
5.0.0.197
2021-09-11
5.0.0.196
2021-09-10
5.0.0.193
2021-09-09
5.0.0.192
2021-09-08
5.0.0.187
2021-09-07
5.0.0.186
2021-09-04
5.0.0.181
2021-09-03
Test TITLE
1 CS 1130 1100 1090 1060 1170 1200 1140 1090 1130 1300 1210 1210 1130 1110 1170 1210 1240 1050 1230 1110 1130 1030 1060 1170 1270 1080 1090 1140 1140 1060
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
2 CS 1200 1200 1390 1200 1190 1150 1300 1140 1230 1440 1270 1290 1280 1180 1450 1200 1220 1200 1230 1150 1150 1190 1170 1340 1190 1110 1190 1180 1210 1240
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
3 SS 1200 1190 1170 1170 1540 1260 1200 1150 1470 1270 1340 1380 1220 1000 1190 1190 1310 1300 1090 1270 1200 1220 1200 1090 1170 1130 1130 1470 1130 1090 1200
Table aliasing is unnecessary required when doing UPDATE ... RETURNING RDB$ pseudo-columns
4 CS 760 770 630 760 840 830 620 820 730 860 960 780 760 800 700 720 900 790 830 820 680 670 680 760 0 690 700 710 610 680
Prohibit ability to cast timestamps that out of valid range to varchar
5 SS 715 720 740 680 710 0 810 0 780 790 830 730 740 740 740 720 740 660 720 700 710 720 680 680 620 620 660 590 590 580 640
Prohibit ability to cast timestamps that out of valid range to varchar
6 CS 1160 1070 1130 1130 1100 1220 1200 1080 1470 1570 1540 1220 1220 1120 1200 1230 1160 1210 1100 1200 1120 1130 1220 1150 1160 1180 1100 1120 1090 1080
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
7 SS 1185 1100 1270 1430 1000 1230 1130 1280 1270 1280 1370 1260 1300 1130 1280 1120 1670 1190 1310 1350 1180 1200 1090 1140 1170 1070 1150 1080 1020 1150 1070
MERGE ... WHEN NOT MATCHED ... RETURNING returns wrong (non-null) values when no insert is performed
8 CS 2550 2670 2580 2610 3040 2610 2530 2370 2260 2810 2550 2280 2740 2690 2620 2290 2300 2640 2440 2000 2290 2550 2190 1940 2000 2260 2760 2600 2720 3060
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
9 SS 2670 2660 2780 2740 2800 2820 2700 2780 2670 3040 3070 2790 2000 2820 2640 2990 0 2550 2770 2880 2660 2840 2420 2110 2070 2510 2460 2410 2420 2540 2440
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
10 CS 4390 4390 4420 4390 4360 4370 4480 4350 4320 4600 4580 4580 4440 4420 4450 4400 4380 4450 4550 4410 4370 4370 4360 4360 4330 4360 4320 4370 4450 4350
ISQL 'SHOW DATABASE' command does not show encryption status of database
11 CS 15930 15230 16830 15960 14390 15770 15140 16110 15930 24600 16180 16300 17270 15000 15170 15960 17490 14850 17580 17520 17010 14510 15390 15160 16200 15590 15000 16150 15320 15150
Performance regression when bulk inserting into table with indices
12 CS 2630 2660 2610 2580 2420 2650 2690 2650 2630 3910 4130 2550 2550 2830 3020 2600 2740 2630 2980 2620 2490 2700 2780 2640 2860 2470 2470 2520 2530 2580
Bad optimization of some operations with views containing subqueries
13 SS 2455 2460 2450 2530 2520 2620 2360 2550 2370 3040 2860 2560 2560 2360 2730 2670 2390 2450 2000 2400 2700 2300 2690 2340 2280 2700 2230 2780 2260 2270 2260
Bad optimization of some operations with views containing subqueries
14 CS 11890 13030 10600 17890 11420 13640 11310 12680 10800 14960 12110 11890 13790 11890 11120 11280 11980 12940 11110 13910 10780 10760 10690 8630 10330 10620 12540 12330 12640 11600
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
15 SS 12450 12000 12530 12970 12780 12070 12460 12450 12680 13360 13460 12380 12810 12470 12660 12290 0 12530 12380 13120 12440 12720 11880 9470 9560 10900 11520 11360 13760 11120 11490
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
16 CS 2690 2940 2660 2730 2540 2770 2700 2610 2660 3070 3480 2780 2730 2870 2740 2660 2870 2790 2800 2740 2620 2650 2310 2430 2690 2660 2560 2530 2650 2600
Bugcheck on queries containing WITH LOCK clause
17 SS 2925 2930 2970 3030 2850 2900 3000 2960 3130 3490 3200 2940 2000 3140 2990 2870 2920 3090 2820 2960 2800 2940 2720 2220 2420 2680 2970 2540 2740 2570 2760
Bugcheck on queries containing WITH LOCK clause
18 CS 5260 4870 4880 5130 7890 5870 4680 6110 6300 5740 5110 7100 5050 6570 4720 4930 6940 6420 6780 6680 5490 6320 4470 4440 4740 5680 5090 5260 4710 4890
Shadow file is can not be created during restore when -use_all_space option is used
19 SS 5085 5330 5270 5480 5000 5390 5760 5320 5610 5660 5600 5530 5260 5000 5060 4910 4870 5300 5710 5130 5110 5020 4850 4310 4200 4840 4970 4620 4760 4720 4990
Shadow file is can not be created during restore when -use_all_space option is used
20 SS 4560 4430 5110 4860 4470 4550 4690 4710 5360 4910 4450 4660 4710 4380 4520 4920 4630 4520 4560 4420 7930 4800 4660 4640 4400 4260 4370 4350 4430 4560 4310
Parse error when compiling a statement causes memory leak until attachment is disconnected
21 CS 3280 3340 3090 3020 3960 3570 3200 3560 3950 3620 3280 3820 3130 3900 3840 3190 3000 3550 4040 3710 3280 3610 2850 2880 3150 3200 3170 3020 3300 2900
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
22 SS 3335 3480 3530 3320 3560 3460 3350 3370 3000 3560 3780 3520 3410 3240 3320 3430 3520 3470 3260 3690 3340 3330 3080 2870 2990 3190 3150 3060 3020 3290 3170
Unable to restore database with tables using GENERATED ALWAYS AS IDENTITY columns (ERROR:OVERRIDING SYSTEM VALUE should be used)
23 CS 700 620 730 780 660 680 770 700 690 770 810 670 650 650 680 720 700 700 720 710 640 660 850 860 760 690 710 700 730 680
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
24 SS 690 710 650 730 690 820 700 690 740 790 870 800 700 690 650 730 690 720 690 760 770 640 630 660 820 650 620 620 630 590 660
Report replica mode through isc_database_info, MON$DATABASE and SYSTEM context
25 CS 1100 1120 1000 1020 1020 1210 1140 1100 1000 3440 3060 1140 1000 1390 1060 1100 1140 1170 1130 1090 1050 1220 1140 1050 1000 1030 1160 1090 1000 1270
Implementation of SUBSTRING for UTF8 character set is inefficient
26 CS 720 670 710 780 720 720 680 720 760 820 720 680 690 680 730 730 700 780 710 730 720 710 740 720 800 670 700 660 790 700
Feature CORE-6482 - System table with keywords.
27 SS 710 830 730 770 720 680 780 770 820 810 830 780 820 660 710 660 710 710 800 720 700 660 640 660 680 620 670 640 630 640 640
Feature CORE-6482 - System table with keywords.
28 CS 19610 18580 22800 19810 20840 19710 18720 20490 19610 20690 21050 20100 20510 20390 20370 20100 19460 18390 18900 20440 17810 21030 18530 19070 18190 17510 18640 18220 18090 17820
Slow performance when executing SQL scripts as non-SYSDBA user [CORE5966]
29 CS 22920 23010 22410 23020 22560 22360 22490 22450 23050 23240 22590 22980 22370 22610 23840 22970 22690 24200 23370 23000 22360 22890 22980 22920 23910 22800 23000 22640 23890 22210
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
30 SS 22675 23720 22420 23230 23180 22510 23130 22730 22000 24260 22510 23280 22550 22530 22870 22470 22620 22540 22530 22230 23000 22740 22510 23850 23260 22780 23150 22570 22560 22870 22350
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
31 SS 21150 6970 7150 7520 7790 80950 81330 256000 34510
Query to mon$ tables does not return data when the encryption/decryption thread is running
32 CS 710 660 730 740 710 730 710 870 630 820 760 660 680 680 960 700 680 680 760 910 840 760 710 800 710 760 690 660 620 670
ISQL - SHOW DATABASE
33 SS 725 800 790 680 740 760 800 0 820 860 930 840 740 740 730 680 0 730 710 760 720 710 690 640 620 680 680 580 630 660 660
ISQL - SHOW DATABASE
34 CS 1620 1480 2030 1520 1790 1560 1850 1670 1640 2010 1810 1650 1440 1770 1610 1550 1760 1620 1630 1600 1550 1830 1430 2140 1690 1480 1620 1580 1450 1520
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
35 SS 1620 1650 1000 1830 1640 1670 1730 1540 1710 1700 1950 1740 1680 1620 1830 1640 10 1530 1680 1620 1560 1700 1600 1550 1470 1450 1440 1430 1360 1000 1360
merge STATEMENT can have only one RETURNING which must be after all WHEN sub-statements.
36 CS 680 730 720 630 730 720 670 680 710 810 0 640 940 640 650 650 720 640 780 680 670 820 680 740 670 760 610 590 670 640
test de la fonction datediff pour avoir le resultat en minute
37 SS 690 670 780 680 660 730 810 810 870 870 880 860 0 700 680 640 0 710 760 680 770 690 640 730 0 670 630 630 560 640 650
test de la fonction datediff pour avoir le resultat en minute
38 CS 2810 3010 2730 3000 2760 2920 2700 2790 2840 3560 3540 2800 2910 2810 2810 2770 2720 2710 2830 2970 2860 2790 1700 1700 3110 2900 2690 2800 2580 2830
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
39 SS 3210 3460 3430 3550 3400 3280 3220 3330 3410 4170 4040 3520 3340 3210 3340 3200 0 3260 3040 3000 3180 3080 2880 1900 1890 2870 3040 2770 2850 2780 2810
Check ability for preparing and then run query with parameters. Query should use ORDER-BY clause.
40 CS 4080 4080 4010 4090 3930 3860 4070 4100 4010 8120 7840 4160 4230 3950 3930 3930 4140 4090 4040 4230 4150 3970 1540 1410 4360 3990 4380 4330 3930 4180
Check ability to run complex query
41 SS 4180 4240 4110 4240 4100 4380 4610 4070 4480 8080 8160 4470 4150 4340 4260 4170 0 4170 4340 4380 4310 4310 4180 1540 1550 3970 4060 3920 3960 4040 4110
Check ability to run complex query
42 CS 6680 6570 8590 6880 6790 6600 6720 6660 6680 7030 7430 6000 6680 7090 6430 6700 6790 6610 7170 6670 6000 6490 6180 9070 7350 8100 6220 6130 6300 6530
gbak utility: check ability to use -ZIP command switch when create backup
43 SS 5955 6080 6110 6160 6130 5950 6540 6370 5960 6210 7040 6000 5960 5630 6230 5900 10 5940 5830 5880 6080 6040 5690 5340 5440 5550 6070 5550 5450 5570 5680
gbak utility: check ability to use -ZIP command switch when create backup

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-3554
http://tracker.firebirdsql.org/browse/core-4774
http://tracker.firebirdsql.org/browse/core-4789
http://tracker.firebirdsql.org/browse/core-4848
http://tracker.firebirdsql.org/browse/core-4928
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5393
http://tracker.firebirdsql.org/browse/core-5538
http://tracker.firebirdsql.org/browse/core-5576
http://tracker.firebirdsql.org/browse/core-5630
http://tracker.firebirdsql.org/browse/core-5646
http://tracker.firebirdsql.org/browse/core-6377
http://tracker.firebirdsql.org/browse/core-6474
http://tracker.firebirdsql.org/browse/core-6542
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/dml/merge_02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/eqc-136030.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/eqc-306263.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/util/gbak_zip.fbt
https://github.com/FirebirdSQL/firebird/issues/310
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/6947

=== end of list ===