0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
[CURRENT] 2. FRESH FAILS: tests which failed for LAST execution only (26 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
5. Has fails: tests with at least one fail for previous runs (68 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (0 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (4388 rows)
8. All tests: outcomes (2286 rows)
9. All tests: durations (4504 rows)
A. Skipped: tests which was intentionally excluded from execution (45 rows)

Generated 05.02.2023 01:01
Tested: FB50.   Build: 5.0.0.930;   SS: 04.02.23 22:46:00 - 04.02.23 23:45:07;   CS: 04.02.23 23:48:42 - 05.02.23 00:58:14;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Tests with result = "FAIL" for last run:
NN Test name mode 5.0.0.930
2023-02-05
5.0.0.927
2023-02-04
5.0.0.923
2023-02-02
5.0.0.920
2023-01-29
5.0.0.917
2023-01-22
5.0.0.916
2023-01-20
5.0.0.915
2023-01-19
5.0.0.914
2023-01-18
5.0.0.912
2023-01-16
5.0.0.910
2023-01-14
5.0.0.908
2023-01-13
5.0.0.907
2023-01-12
5.0.0.905
2023-01-11
5.0.0.890
2023-01-06
5.0.0.888
2023-01-01
5.0.0.884
2022-12-24
5.0.0.883
2022-12-23
5.0.0.882
2022-12-22
5.0.0.879
2022-12-21
5.0.0.877
2022-12-17
5.0.0.871
2022-12-14
5.0.0.870
2022-12-13
5.0.0.869
2022-12-12
5.0.0.867
2022-12-11
5.0.0.865
2022-12-10
5.0.0.863
2022-12-07
5.0.0.862
2022-12-04
5.0.0.861
2022-12-03
5.0.0.860
2022-12-02
5.0.0.848
2022-11-29
Test TITLE
1 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
4 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
5 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
7 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Ability to query Firebird configuration using SQL
8 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Ability to query Firebird configuration using SQL
9 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
10 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
11 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
12 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
13 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
14 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
15 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
16 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
17 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order LIKE and STARTING WITH
18 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order LIKE and STARTING WITH
19 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match and reference in WHERE clause
20 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match and reference in WHERE clause
21 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
22 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
23 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
24 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
25 CS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Mixed JOINS
26 SS     F     X     F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Mixed JOINS

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.930
2023-02-05
5.0.0.927
2023-02-04
5.0.0.923
2023-02-02
5.0.0.920
2023-01-29
5.0.0.917
2023-01-22
5.0.0.916
2023-01-20
5.0.0.915
2023-01-19
5.0.0.914
2023-01-18
5.0.0.912
2023-01-16
5.0.0.910
2023-01-14
5.0.0.908
2023-01-13
5.0.0.907
2023-01-12
5.0.0.905
2023-01-11
5.0.0.890
2023-01-06
5.0.0.888
2023-01-01
5.0.0.884
2022-12-24
5.0.0.883
2022-12-23
5.0.0.882
2022-12-22
5.0.0.879
2022-12-21
5.0.0.877
2022-12-17
5.0.0.871
2022-12-14
5.0.0.870
2022-12-13
5.0.0.869
2022-12-12
5.0.0.867
2022-12-11
5.0.0.865
2022-12-10
5.0.0.863
2022-12-07
5.0.0.862
2022-12-04
5.0.0.861
2022-12-03
5.0.0.860
2022-12-02
5.0.0.848
2022-11-29
Test TITLE
1 CS 1410 2010 1420 1390 1420 1410 1480 1380 1530 1520 1470 1490 1490 1400 1480 1390 1400 1640 1360 1380 1410 1430 1400 1350 1380 1400 1350 1410 1370
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS 1340 1560 1340 1340 1390 1330 1480 1390 1430 1550 1420 1300 1420 1330 1320 1410 1420 1380 1300 1350 1270 1340 1330 1340 1340 1230 1340 1350 1340
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS 795 760 740 780 740 780 790 870 850 880 800 820 840 770 780 780 790 850 830 770 690 800 840 810 730 840 850 810 790
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
4 SS 680 630 680 680 680 690 670 650 760 770 0 670 740 730 790 730 680 690 660 690 630 670 710 660 670 660 710 760 730
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
5 CS 860 1200 830 860 860 860 870 920 910 970 890 890 870 900 860 860 920 880 830 830 860 860 920 890 810 840 840 790 850
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 SS 800 1060 740 800 800 820 770 810 860 870 800 800 770 790 840 730 790 790 790 840 780 760 740 810 770 830 820 830 830
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
7 CS 2515 2510 2420 2580 2490 2430 2480 2420 2530 2540 2510 2630 2530 2590 2520 2580 2630 2630 2530 2390 2460 2570 2410 2490 2540 2400 2410 2360 2580
Ability to query Firebird configuration using SQL
8 SS 2365 2340 2280 2220 2400 2470 2380 2330 2410 2390 2410 2370 2440 2290 2320 2370 2450 2480 2290 2340 2560 2190 2350 2370 2400 2360 2330 2300 2340
Ability to query Firebird configuration using SQL
9 CS 4170 4350 3890 4030 4430 3840 4280 3970 4590 4440 4260 3910 4140 4470 4420 4390 3930 4060 4290 3920 4570 4540 4170 4610 4170 3000 3700 3970 3830
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
10 SS 3865 3670 4000 4530 3930 4510 3710 3610 3770 3640 4100 4170 3860 3780 4020 3590 3580 4300 3970 3810 4160 3570 3740 3600 4550 3870 4460 3000 4040
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
11 CS 1775 1740 1800 1790 1810 1770 1780 1820 1810 1840 1000 1810 1770 1730 1790 1760 1850 1810 1780 1840 1720 1760 1790 1720 1740 1730 1760 1720 1770
FULL OUTER JOIN, list all values, but filtered in WHERE clause
12 SS 1685 1900 1650 1680 1680 1690 1690 1680 1790 1760 1690 1660 1710 1640 1720 1670 1670 1690 1730 1610 1700 1710 1670 1680 1720 1660 1630 1630 1710
FULL OUTER JOIN, list all values, but filtered in WHERE clause
13 CS 1785 1790 1760 1760 1740 1000 1770 1780 1930 1830 1820 1730 1810 1800 1740 1780 1000 1850 1000 1800 1790 1820 1710 1700 1720 1840 1820 1800 1830
FULL OUTER JOIN, list all values, but filtered in WHERE clause
14 SS 1680 1900 1640 1660 1670 1660 1620 1660 1780 1000 1700 1720 1720 1700 1670 1670 1740 1690 1680 1660 1740 1680 1740 1710 1650 1740 1000 1650 1730
FULL OUTER JOIN, list all values, but filtered in WHERE clause
15 CS 1800 1780 1860 1840 1740 1000 1720 1890 1860 1910 1800 1840 1790 1770 1730 1770 1840 1850 1820 1780 1820 1880 1840 1770 1760 1000 1720 1810 1800
FULL OUTER JOIN, list all values, but filtered in WHERE clause
16 SS 1690 1860 1650 1660 1670 1690 1670 1690 1850 1720 1700 1680 1700 1690 1710 1650 1680 1690 1670 1670 1650 1710 1710 1680 1770 1730 1650 1690 1680
FULL OUTER JOIN, list all values, but filtered in WHERE clause
17 CS 1005 950 950 960 900 1040 950 1000 1030 1070 980 1060 1050 1040 1010 1010 1040 1050 910 980 1070 1010 1000 950 1060 940 860 980 1050
INNER JOIN join order LIKE and STARTING WITH
18 SS 895 1140 860 930 870 930 930 880 970 910 930 980 960 960 850 890 910 900 900 860 890 840 870 840 820 880 860 850 980
INNER JOIN join order LIKE and STARTING WITH
19 CS 835 860 780 840 850 850 910 770 910 870 810 810 800 840 820 860 860 920 820 850 810 870 830 810 800 780 840 830 770
LEFT OUTER JOIN with full match and reference in WHERE clause
20 SS 720 1010 670 720 720 740 730 680 810 760 740 870 720 0 800 700 0 720 790 720 0 760 690 690 0 670 740 0 720
LEFT OUTER JOIN with full match and reference in WHERE clause
21 CS 830 830 860 830 840 820 840 820 900 950 800 900 830 810 860 860 910 810 820 860 870 840 780 790 770 890 830 730 0
LEFT OUTER JOIN with full match, but limited in ON clause
22 SS 730 970 770 740 710 710 710 0 790 760 0 710 730 700 710 710 820 790 720 800 740 850 700 0 710 690 740 770 700
LEFT OUTER JOIN with full match, but limited in ON clause
23 CS 840 1050 830 810 840 830 840 850 900 920 850 850 860 810 810 810 840 1000 880 830 800 760 850 950 840 840 840 780 880
LEFT OUTER JOIN with STARTING WITH in WHERE clause
24 SS 725 910 720 760 740 730 720 710 840 850 720 0 820 720 730 0 760 730 710 780 690 730 720 770 700 690 720 680 680
LEFT OUTER JOIN with STARTING WITH in WHERE clause
25 CS 950 1010 940 950 1010 930 940 970 1080 1240 980 940 950 980 870 970 970 970 960 1180 910 950 900 870 990 870 890 880 950
Mixed JOINS
26 SS 870 1150 770 850 850 870 900 880 890 1080 870 860 890 840 830 910 950 840 940 890 870 850 920 860 870 860 840 840 940
Mixed JOINS

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2078
http://tracker.firebirdsql.org/browse/core-4528
http://tracker.firebirdsql.org/browse/core-5236
http://tracker.firebirdsql.org/browse/core-6444
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_04.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_05.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_mixed_joins_05.fbt
https://github.com/FirebirdSQL/firebird/issues/6802

=== end of list ===