0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (8 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (40 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (1 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2277 rows)
9. All tests: durations (4498 rows)
A. Skipped: tests which was intentionally excluded from execution (3 rows)

Generated 27.09.2022 08:24
Tested: FB50.   Build: 5.0.0.756;   CS: 27.09.22 07:20:06 - 27.09.22 08:22:20;   SS: 27.09.22 06:03:33 - 27.09.22 07:16:52;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 5.0.0.756
2022-09-27
5.0.0.745
2022-09-26
5.0.0.743
2022-09-24
5.0.0.742
2022-09-23
5.0.0.739
2022-09-21
5.0.0.736
2022-09-18
5.0.0.734
2022-09-17
5.0.0.733
2022-09-16
5.0.0.731
2022-09-15
5.0.0.730
2022-09-14
5.0.0.727
2022-09-10
5.0.0.721
2022-09-09
5.0.0.714
2022-09-07
5.0.0.706
2022-09-07
5.0.0.701
2022-09-03
5.0.0.698
2022-09-02
5.0.0.694
2022-09-02
5.0.0.675
2022-08-16
5.0.0.628
2022-08-09
5.0.0.623
2022-08-03
5.0.0.600
2022-08-02
5.0.0.599
2022-08-01
5.0.0.598
2022-07-26
5.0.0.592
2022-07-23
5.0.0.591
2022-07-20
5.0.0.590
2022-07-17
5.0.0.588
2022-07-15
5.0.0.583
2022-07-14
5.0.0.582
2022-07-11
5.0.0.580
2022-07-10
Test TITLE
1 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
2 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
3 CS     F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Using both the procedure name and alias inside an explicit plan crashes the server
4 SS     F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Using both the procedure name and alias inside an explicit plan crashes the server
5 SS P P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
6 SS P P P P P P P P P P P P P     F     P P P P P     F         F     P     F     P P P P P P     F    
FBTRACEMGR should understand 'role <name>' command switch (needed to explicitly connect with role with 'TRACE_ANY_ATTACHMENT' privilege)
7 CS P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P
Performance regression when bulk inserting into table with indices
8 CS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
Bad optimization of some operations with views containing subqueries
9 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Support for DROP IDENTITY clause
10 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Support for DROP IDENTITY clause
11 CS P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P
Badly selective index could be used for extra filtering even if selective index is used for sorting
12 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
13 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
14 CS P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
15 SS P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
16 SS P P P P P P P P P P P P P     F         F         F         F         F     P P P P P P P P P P P P
Built-in cryptographic functions
17 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P     F         F    
Ability to query Firebird configuration using SQL
18 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P     F         F    
Ability to query Firebird configuration using SQL
19 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F    
Getting "records fetched" for functions/procedures in trace
20 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
21 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F    
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
22 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
23 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
24 CS P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
25 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$FIELDS
26 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$FIELDS
27 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$FUNCTION_ARGUMENTS
28 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$FUNCTION_ARGUMENTS
29 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$FUNCTIONS
30 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$FUNCTIONS
31 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$PROCEDURE_PARAMETERS
32 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New DB - RDB$PROCEDURE_PARAMETERS
33 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New database: content of RDB$PROCEDURES
34 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
New database: content of RDB$PROCEDURES
35 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$SECURITY_CLASSES
36 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$SECURITY_CLASSES
37 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$TYPES
38 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$TYPES
39 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$USER_PRIVILEGES
40 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Empty DB - RDB$USER_PRIVILEGES

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.756
2022-09-27
5.0.0.745
2022-09-26
5.0.0.743
2022-09-24
5.0.0.742
2022-09-23
5.0.0.739
2022-09-21
5.0.0.736
2022-09-18
5.0.0.734
2022-09-17
5.0.0.733
2022-09-16
5.0.0.731
2022-09-15
5.0.0.730
2022-09-14
5.0.0.727
2022-09-10
5.0.0.721
2022-09-09
5.0.0.714
2022-09-07
5.0.0.706
2022-09-07
5.0.0.701
2022-09-03
5.0.0.698
2022-09-02
5.0.0.694
2022-09-02
5.0.0.675
2022-08-16
5.0.0.628
2022-08-09
5.0.0.623
2022-08-03
5.0.0.600
2022-08-02
5.0.0.599
2022-08-01
5.0.0.598
2022-07-26
5.0.0.592
2022-07-23
5.0.0.591
2022-07-20
5.0.0.590
2022-07-17
5.0.0.588
2022-07-15
5.0.0.583
2022-07-14
5.0.0.582
2022-07-11
5.0.0.580
2022-07-10
Test TITLE
1 CS 1040 970 1050 1060 980 1100 1140 1070 1150 1120 1080 1020 1080 900 930 1010 1010 980 1130 1160 1110 1070 1030 1000 1050 1070 1030 990 970 940 880
Improve sorting performance when long VARCHARs are involved
2 SS 1315 1200 1300 1430 1190 1340 1420 1370 1410 1390 1330 1350 1390 1290 1230 1260 1190 1000 1280 1280 1240 1210 1350 1390 1300 1350 1200 1420 1400 1330 970
Improve sorting performance when long VARCHARs are involved
3 CS 730 710 760 760 770 840 800 790 800 800 760 790 770 660 700 760 650 650 780 690 730 780 680 680 730 680 690 710 0 670 620
Using both the procedure name and alias inside an explicit plan crashes the server
4 SS 1015 1020 970 970 970 1040 1050 1140 1140 1060 1060 990 1090 980 980 910 940 1020 1030 930 970 970 1080 1070 1040 1060 980 1010 1000 1110 760
Using both the procedure name and alias inside an explicit plan crashes the server
5 SS 16325 14800 15290 14780 15190 15760 16430 16060 16610 16170 17280 16340 17820 16590 16240 16970 16160 15870 16430 16040 16200 16320 17970 16820 17330 16810 15800 16330 17140 17260 13420
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
6 SS 4785 4940 4780 4860 4800 4940 4970 4990 4910 4990 4930 4990 4880 4660 4560 4570 4650 4780 4630 4730 4610 4690 4000 4790 4800 4810 4710 4790 4650 4740 4370
FBTRACEMGR should understand 'role <name>' command switch (needed to explicitly connect with role with 'TRACE_ANY_ATTACHMENT' privilege)
7 CS 70150 60330 59280 59560 55340 69570 70180 74030 71550 72570 70120 71820 71490 69800 72210 74690 73720 71550 80210 82980 77330 75330 72520 23520 22670 22780 22410 22830 22380 21860 19460
Performance regression when bulk inserting into table with indices
8 CS 2885 2760 2760 2710 2770 2900 2960 2990 2960 2950 2970 3030 2910 2730 2960 3050 3000 2880 3060 3030 2690 2870 2910 2830 2890 2800 2800 2800 2830 2760 2470
Bad optimization of some operations with views containing subqueries
9 CS 790 760 820 810 780 850 880 820 840 920 790 820 800 740 730 800 710 700 770 860 740 840 770 780 780 0 770 830 730 830 670
Support for DROP IDENTITY clause
10 SS 1060 1180 1050 1010 1000 1160 1160 1210 1070 1130 1200 1110 1100 960 1010 1010 1050 1080 1050 1000 1050 1010 1030 1220 1150 1070 1050 1040 1080 1090 850
Support for DROP IDENTITY clause
11 CS 5500 5520 5570 5570 5490 5620 5810 5670 5820 5950 5650 5670 5920 5340 5620 5290 5660 5410 5480 5510 5460 5470 5460 5600 5370 5490 5440 5470 5470 5490 5110
Badly selective index could be used for extra filtering even if selective index is used for sorting
12 CS 7115 7110 7110 7120 7160 7000 7000 7190 7210 7230 7300 7330 7220 7010 7050 7000 7040 7030 7110 7180 7130 7150 7150 7080 7070 7120 7080 7120 7120 7080 6880
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
13 SS 7230 7230 7240 7190 7240 7390 7390 7410 7400 7380 7380 7280 7380 7260 7210 7100 7110 7170 7210 7140 7000 7290 7220 7350 7230 7210 7210 7180 7160 7330 6920
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
14 CS 132425 133140 132930 132010 132400 131830 132550 133100 133130 132210 132720 131470 132610 131540 132520 131730 132200 132540 131660 132790 132470 132900 132510 132450 131330 131340 131780 132510 131730 131850 131390
Sometime it is impossible to cancel\kill connection executing external query
15 SS 133510 132620 133590 133550 132590 134770 133690 133790 134760 133740 133780 132710 132820 132490 132460 133440 133540 133510 132560 134480 132450 133480 132470 133630 133600 133640 133530 132620 133510 132570 133260
Sometime it is impossible to cancel\kill connection executing external query
16 SS 2245 1970 1930 2010 1910 2190 2860 2260 2190 2960 2440 2340 2430 2300 2340 2000 1960 2090 2310 2310 2310 2510 2140 2130 2310 2230 2220 2070 2420 2310 1830
Built-in cryptographic functions
17 CS 2655 2470 2370 2600 2480 2670 2620 2660 2740 2780 2600 2650 2710 2740 2570 2590 2710 2610 2830 2720 2790 2690 2710 2680 2600 2610 2760 2590 2680 2650 2040
Ability to query Firebird configuration using SQL
18 SS 2800 2610 2690 2630 2670 2910 2850 2710 2810 2000 2820 2720 2800 2840 2790 2720 2840 2740 2790 2840 2930 2810 2850 2860 2800 3010 2850 2770 2000 2820 2040
Ability to query Firebird configuration using SQL
19 SS 4575 4560 4550 4000 4520 4810 4840 4760 4700 4640 4710 4790 4690 4470 4580 4480 4560 4560 4530 4570 4560 4690 4620 4690 4530 4590 4550 4570 4760 4610 4240
Getting "records fetched" for functions/procedures in trace
20 CS 181520 166940 170850 173850 173800 188950 181990 186060 188040 183930 184940 179010 181020 180900 172950 171860 182930 177910 197020 177990 177940 181050 191000 196330 195000 190950 189930 191990 188050 108930 86790
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
21 SS 181795 168730 172710 178680 182720 184900 183810 181780 180840 179900 182730 177720 179810 182740 172830 173720 183770 181780 181810 180800 178870 181880 182880 198030 194970 193890 185760 186870 184790 108230 86920
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
22 CS 4330 4420 3880 3860 3820 3700 4160 4690 4340 3910 4540 4450 3990 4580 4570 4560 4670 4400 4320 3940 3770 4460 4510 4000 3940 3800 3840 3690 22230 22590 21700
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
23 SS 4515 4550 4700 4030 4670 4070 4550 4660 3900 4480 4130 4790 4770 4140 4000 4390 4050 3930 4010 4450 4180 4390 4790 4630 4930 4600 4140 4730 22390 23880 22080
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
24 CS 4620 4360 4240 4550 4770 4700 4630 4540 4510 4380 4810 4540 4360 4600 4450 4430 4710 4560 4720 4610 4520 4810 4700 4950 5180 4840 4880 4630 4770 4900 4080
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
25 CS 665 650 650 650 660 680 660 710 690 720 700 700 680 640 630 630 710 670 630 690 680 660 640 670 680 640 710 640 670 660 530
Empty DB - RDB$FIELDS
26 SS 875 800 780 760 810 930 940 980 890 960 870 860 850 860 840 920 830 900 820 870 910 970 900 900 850 880 890 950 790 920 660
Empty DB - RDB$FIELDS
27 CS 570 530 600 480 480 540 610 540 630 560 630 600 580 560 490 550 600 520 650 590 570 570 570 580 540 540 530 630 570 590 460
New DB - RDB$FUNCTION_ARGUMENTS
28 SS 790 700 760 680 770 830 0 800 820 810 800 830 740 760 740 740 800 780 730 850 770 900 800 780 810 790 0 830 790 810 580
New DB - RDB$FUNCTION_ARGUMENTS
29 CS 560 550 540 590 510 630 600 550 560 610 590 550 610 580 560 520 590 520 540 620 530 590 610 550 520 530 570 550 580 560 490
New DB - RDB$FUNCTIONS
30 SS 790 690 710 690 740 0 800 860 840 820 0 810 800 720 810 680 760 780 730 810 800 820 820 860 760 850 770 770 810 780 520
New DB - RDB$FUNCTIONS
31 CS 570 540 600 560 560 580 610 610 620 590 620 590 630 530 560 520 610 530 540 610 580 570 590 570 570 570 550 510 570 540 470
New DB - RDB$PROCEDURE_PARAMETERS
32 SS 790 920 710 760 0 900 760 840 880 970 820 840 820 770 700 800 770 760 710 770 760 870 760 800 820 820 820 790 780 770 580
New DB - RDB$PROCEDURE_PARAMETERS
33 CS 560 550 580 530 510 580 580 560 560 650 560 610 630 600 540 510 530 570 570 590 580 570 590 590 560 550 560 540 540 560 0
New database: content of RDB$PROCEDURES
34 SS 780 730 730 730 740 820 790 820 770 770 810 800 850 730 700 0 0 700 740 790 720 830 830 840 800 840 710 800 770 910 590
New database: content of RDB$PROCEDURES
35 CS 720 670 690 630 690 0 0 830 770 790 780 740 0 720 720 670 700 720 810 710 770 740 740 680 710 760 700 730 730 770 650
Empty DB - RDB$SECURITY_CLASSES
36 SS 950 850 840 840 850 970 990 950 1000 1030 920 950 950 900 810 880 920 880 1030 960 950 940 910 1010 1000 1000 890 1000 950 970 700
Empty DB - RDB$SECURITY_CLASSES
37 CS 620 590 640 600 550 660 640 630 660 620 630 620 660 600 550 560 620 630 630 590 570 630 620 640 620 620 560 600 630 640 520
Empty DB - RDB$TYPES
38 SS 830 760 780 810 780 930 910 780 860 890 840 840 860 820 830 0 840 800 800 900 800 830 790 870 860 850 800 860 790 850 620
Empty DB - RDB$TYPES
39 CS 740 0 740 700 690 780 0 790 730 790 810 810 800 710 790 760 0 740 800 740 790 720 810 720 710 720 740 690 740 0 650
Empty DB - RDB$USER_PRIVILEGES
40 SS 955 910 850 800 860 930 1040 1080 960 1050 930 1030 970 860 950 870 950 970 940 970 900 960 940 1030 970 1140 1070 990 980 950 690
Empty DB - RDB$USER_PRIVILEGES

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2650
http://tracker.firebirdsql.org/browse/core-3064
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5269
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5393
http://tracker.firebirdsql.org/browse/core-5431
http://tracker.firebirdsql.org/browse/core-5435
http://tracker.firebirdsql.org/browse/core-5488
http://tracker.firebirdsql.org/browse/core-5685
http://tracker.firebirdsql.org/browse/core-5970
http://tracker.firebirdsql.org/browse/core-6444
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_07.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_11.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_12.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_19.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_20.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_26.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_30.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/db/db_31.fbt
https://github.com/FirebirdSQL/firebird/issues/6782
https://github.com/FirebirdSQL/firebird/issues/6785
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/6875

=== end of list ===