0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (6 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (2 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (2240 rows)
9. All tests: durations (4466 rows)
A. Skipped: tests which was intentionally excluded from execution (34 rows)

Generated 05.02.2023 05:17
Tested: FB30.   Build: 3.0.11.33659;   CS: 05.02.23 04:29:20 - 05.02.23 05:15:44;   SS: 05.02.23 03:28:14 - 05.02.23 04:26:14;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.11.33659
2023-02-05
3.0.11.33658
2023-02-02
3.0.11.33657
2023-01-29
3.0.11.33654
2023-01-17
3.0.11.33653
2023-01-16
3.0.11.33652
2023-01-06
3.0.11.33650
2022-12-26
3.0.11.33648
2022-12-14
3.0.11.33647
2022-12-10
3.0.11.33646
2022-12-07
3.0.11.33642
2022-11-25
3.0.11.33640
2022-11-04
3.0.11.33639
2022-10-29
3.0.11.33637
2022-10-27
3.0.11.33636
2022-10-20
3.0.11.33635
2022-10-17
3.0.11.33634
2022-10-15
3.0.11.33632
2022-10-01
3.0.11.33631
2022-09-25
3.0.11.33629
2022-09-18
3.0.11.33628
2022-09-14
3.0.11.33627
2022-09-13
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-09
3.0.11.33620
2022-09-02
3.0.11.33619
2022-09-02
3.0.11.33617
2022-08-16
3.0.11.33616
2022-08-09
3.0.11.33614
2022-08-02
3.0.11.33613
2022-07-31
Test TITLE
1 SS P P X P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS P P X P P P P P P P     F     P P P P P P P P P P P P P P P P P P P
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
3 SS P P X P P P P P P P P P P P P P P P P P     F     P     F     P P P P P P P
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
4 SS P     F     X P P P P P P P P P P P P P P P P P P P P P P P P P P P
SELECT WITH LOCK may raise unexpected update conflict errors under concurrent load
5 CS P P X     F         F     P P P P P P P P P P P P P P P P P P P     F     P P P     F     P
Performance regression when bulk inserting into table with indices
6 SS P P X P P P P P P P P P P P P P P P P P P P P P P P P     F         F     P
Performance regression when bulk inserting into table with indices

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.11.33659
2023-02-05
3.0.11.33658
2023-02-02
3.0.11.33657
2023-01-29
3.0.11.33654
2023-01-17
3.0.11.33653
2023-01-16
3.0.11.33652
2023-01-06
3.0.11.33650
2022-12-26
3.0.11.33648
2022-12-14
3.0.11.33647
2022-12-10
3.0.11.33646
2022-12-07
3.0.11.33642
2022-11-25
3.0.11.33640
2022-11-04
3.0.11.33639
2022-10-29
3.0.11.33637
2022-10-27
3.0.11.33636
2022-10-20
3.0.11.33635
2022-10-17
3.0.11.33634
2022-10-15
3.0.11.33632
2022-10-01
3.0.11.33631
2022-09-25
3.0.11.33629
2022-09-18
3.0.11.33628
2022-09-14
3.0.11.33627
2022-09-13
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-09
3.0.11.33620
2022-09-02
3.0.11.33619
2022-09-02
3.0.11.33617
2022-08-16
3.0.11.33616
2022-08-09
3.0.11.33614
2022-08-02
3.0.11.33613
2022-07-31
Test TITLE
1 SS 1860 1850 1940 1920 1890 1930 1940 1830 1760 1880 1820 1840 1870 1880 1780 1820 1870 1830 1860 1950 1980 2060 1760 1720 1870 1800 1840 1840 1860 1880
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS 2070 2070 2230 2030 2120 2050 2040 2080 2080 2080 2050 2080 2050 2160 2140 2110 2070 2220 2020 2200 2130 2130 1970 2040 2000 2060 2010 2000 1940 2030
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
3 SS 14840 14360 12950 14930 14000 14720 15520 14900 15090 14340 15200 14040 14700 14700 15680 14550 14560 14570 14840 15620 16260 16000 15290 14940 14420 14740 14960 14210 14960 15310
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
4 SS 10140 10000 20810 10150 10100 10120 10130 10120 10140 10170 10110 10210 10130 10300 10240 10120 10120 10160 10080 10170 10130 10000 10160 10000 10320 10140 10170 10140 10210 10220
SELECT WITH LOCK may raise unexpected update conflict errors under concurrent load
5 CS 65810 63180 53090 66650 67260 59910 64610 59440 58220 56550 59430 67420 57780 65810 55060 62100 57440 57610 65360 71290 71490 73980 71000 74790 75510 74980 80820 75510 87150 79420
Performance regression when bulk inserting into table with indices
6 SS 64530 61390 83280 67060 65920 60820 64530 58310 58970 59110 55830 59460 61990 59800 57730 61000 58990 59100 60950 73810 72660 72180 72160 73910 75310 75540 82490 87880 86780 77870
Performance regression when bulk inserting into table with indices

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2078
http://tracker.firebirdsql.org/browse/core-4058
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5222
http://tracker.firebirdsql.org/browse/core-5302

=== end of list ===