0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (4 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (3 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (13 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (0 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (1 rows)
8. All tests: outcomes (2293 rows)
9. All tests: durations (4558 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 02.10.2022 08:22
Tested: FB50.   Build: 5.0.0.763;   CS: 02.10.22 07:12:06 - 02.10.22 08:21:22;   SS: 02.10.22 06:01:47 - 02.10.22 07:10:26;
OS and hardware info:  Windows 10 10.0.19041 ; logical CPUs: 8 ; total memory: 31.7 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 5.0.0.763
2022-10-02
5.0.0.762
2022-10-01
5.0.0.760
2022-09-30
5.0.0.758
2022-09-29
5.0.0.756
2022-09-27
5.0.0.745
2022-09-26
5.0.0.743
2022-09-24
5.0.0.742
2022-09-23
5.0.0.739
2022-09-21
5.0.0.736
2022-09-18
5.0.0.734
2022-09-17
5.0.0.733
2022-09-16
5.0.0.731
2022-09-15
5.0.0.730
2022-09-14
5.0.0.727
2022-09-10
5.0.0.721
2022-09-09
5.0.0.714
2022-09-07
5.0.0.706
2022-09-05
5.0.0.701
2022-09-03
5.0.0.698
2022-09-02
5.0.0.694
2022-08-30
5.0.0.692
2022-08-29
5.0.0.691
2022-08-25
5.0.0.689
2022-08-24
5.0.0.688
2022-08-23
5.0.0.685
2022-08-22
5.0.0.684
2022-08-20
5.0.0.681
2022-08-19
5.0.0.677
2022-08-18
5.0.0.676
2022-08-17
Test TITLE
1 CS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
2 SS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
3 CS P P     F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Using both the procedure name and alias inside an explicit plan crashes the server
4 SS P P     F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Using both the procedure name and alias inside an explicit plan crashes the server
5 CS P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Crash on infinite mutual SP calls (instead of "Too many concurrent executions of the same request.")
6 SS P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Crash on infinite mutual SP calls (instead of "Too many concurrent executions of the same request.")
7 CS P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
8 SS P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
9 SS     F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P
Extend trace record for COMMIT/ROLLBACK RETAINING to allow chaining of transaction ids
10 SS P     F     P P P     F     P P     F         F     P P P P P P P P     F     P     F         F         F     P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P P
Query to mon$ tables does not return data when the encryption/decryption thread is running
12 CS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Check list of files in the current Firebird snapshot
13 SS P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P
Check list of files in the current Firebird snapshot

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.763
2022-10-02
5.0.0.762
2022-10-01
5.0.0.760
2022-09-30
5.0.0.758
2022-09-29
5.0.0.756
2022-09-27
5.0.0.745
2022-09-26
5.0.0.743
2022-09-24
5.0.0.742
2022-09-23
5.0.0.739
2022-09-21
5.0.0.736
2022-09-18
5.0.0.734
2022-09-17
5.0.0.733
2022-09-16
5.0.0.731
2022-09-15
5.0.0.730
2022-09-14
5.0.0.727
2022-09-10
5.0.0.721
2022-09-09
5.0.0.714
2022-09-07
5.0.0.706
2022-09-05
5.0.0.701
2022-09-03
5.0.0.698
2022-09-02
5.0.0.694
2022-08-30
5.0.0.692
2022-08-29
5.0.0.691
2022-08-25
5.0.0.689
2022-08-24
5.0.0.688
2022-08-23
5.0.0.685
2022-08-22
5.0.0.684
2022-08-20
5.0.0.681
2022-08-19
5.0.0.677
2022-08-18
5.0.0.676
2022-08-17
Test TITLE
1 CS 910 950 910 1010 920 930 920 970 910 910 920 920 1000 970 920 910 940 760 780 870 770 0 840 760 760 0 760 760 760 0 780
Improve sorting performance when long VARCHARs are involved
2 SS 830 880 900 900 830 910 830 910 860 840 850 880 850 910 920 850 890 740 830 770 710 720 730 780 740 790 0 780 790 800 730
Improve sorting performance when long VARCHARs are involved
3 CS 840 850 1110 1240 840 840 840 840 830 860 850 980 840 860 1180 860 940 970 760 690 700 1050 680 690 690 1010 690 690 670 700 710
Using both the procedure name and alias inside an explicit plan crashes the server
4 SS 770 790 770 780 780 810 770 760 790 800 1070 810 950 780 790 770 770 650 650 650 640 660 660 630 640 650 630 820 640 670 680
Using both the procedure name and alias inside an explicit plan crashes the server
5 CS 1010 920 960 940 940 1010 960 960 980 950 920 1010 980 910 940 940 1010 5780 6140 4790 4950 4910 5070 4930 5180 5260 5070 5040 5700 4880 5080
Crash on infinite mutual SP calls (instead of "Too many concurrent executions of the same request.")
6 SS 900 870 880 890 870 890 880 870 900 900 880 890 860 870 870 900 880 6260 6990 7060 6140 6490 6440 6610 6890 6410 5910 7070 6280 6610 6070
Crash on infinite mutual SP calls (instead of "Too many concurrent executions of the same request.")
7 CS 23375 23510 23390 23410 23370 23380 23380 23390 23410 23400 23460 23390 23380 23350 23370 23400 23450 23220 23190 23230 23580 23180 23540 23220 23180 23190 23160 23190 23290 23280 23240
Sometime it is impossible to cancel\kill connection executing external query
8 SS 23365 23470 23000 23470 23520 23510 23490 23490 23460 23580 24140 23490 23570 23560 23450 23570 23480 23160 23190 23220 23170 23160 23240 23200 23210 23270 23190 23190 23210 23260 23280
Sometime it is impossible to cancel\kill connection executing external query
9 SS 5080 5070 5120 5120 5110 5140 5080 5120 5550 5080 5630 5600 5090 5590 5570 5100 5090 4930 4920 4970 5080 4940 4880 4890 4940 5380 4900 4890 4950 4930 4910
Extend trace record for COMMIT/ROLLBACK RETAINING to allow chaining of transaction ids
10 SS 3205 3160 4120 3130 3150 3150 3560 3320 3200 3590 3590 3210 3170 3580 3380 3220 3170 3000 3840 3550 3150 3800 3590 3560 3090 3120 3110 3180 3440 3140 3090
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS 5730 5240 5900 5420 5230 5230 5280 5730 5990 5830 11710 6410 5810 5340 5730 6710 5650 5270 5230 5940 5460 6110 6000 5170 6160 6700 5620 6330 5510 6540 5470
Query to mon$ tables does not return data when the encryption/decryption thread is running
12 CS 630 630 610 640 620 600 610 600 610 650 630 650 610 600 650 690 670 630 620 600 630 640 620 630 660 670 610 650 620 620 640
Check list of files in the current Firebird snapshot
13 SS 545 540 530 560 520 560 530 550 530 540 530 560 710 530 550 560 560 560 540 520 550 530 530 570 540 530 540 560 550 560 640
Check list of files in the current Firebird snapshot

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2650
http://tracker.firebirdsql.org/browse/core-3064
http://tracker.firebirdsql.org/browse/core-4653
http://tracker.firebirdsql.org/browse/core-5685
http://tracker.firebirdsql.org/browse/core-6095
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/build/snapshot-files-check-list.fbt
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/6947

=== end of list ===