0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (3 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (22 rows)
5. Has fails: tests with at least one fail for previous runs (92 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (1 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2333 rows)
9. All tests: durations (4570 rows)
A. Skipped: tests which was intentionally excluded from execution (48 rows)

Generated 05.02.2023 03:26
Tested: FB50.   Build: 5.0.0.930;   SS: 05.02.23 01:32:45 - 05.02.23 02:22:45;   CS: 05.02.23 02:24:27 - 05.02.23 03:24:22;
OS and hardware info:  Windows 10 10.0.19041 ; logical CPUs: 8 ; total memory: 31.7 Gb 

Tests which fail for at least two last runs:
NN Test name mode 5.0.0.930
2023-02-05
5.0.0.928
2023-02-03
5.0.0.923
2023-02-02
5.0.0.920
2023-01-28
5.0.0.917
2023-01-22
5.0.0.916
2023-01-20
5.0.0.915
2023-01-31
5.0.0.914
2023-01-18
5.0.0.912
2023-01-16
5.0.0.910
2023-01-14
5.0.0.908
2023-01-13
5.0.0.907
2023-01-12
5.0.0.905
2023-01-11
5.0.0.890
2023-01-07
5.0.0.888
2023-01-01
5.0.0.884
2022-12-24
5.0.0.883
2022-12-23
5.0.0.882
2022-12-22
5.0.0.879
2022-12-21
5.0.0.877
2022-12-17
5.0.0.871
2022-12-14
5.0.0.870
2022-12-13
5.0.0.869
2022-12-12
5.0.0.867
2022-12-11
5.0.0.865
2022-12-10
5.0.0.863
2022-12-07
5.0.0.862
2022-12-05
5.0.0.848
2022-11-29
5.0.0.847
2022-11-27
5.0.0.845
2022-11-26
Test TITLE
1 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
4 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
5 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
7 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
8 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
9 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
10 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
11 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
12 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
FULL OUTER JOIN, list all values, but filtered in WHERE clause
13 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order LIKE and STARTING WITH
14 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order LIKE and STARTING WITH
15 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match and reference in WHERE clause
16 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match and reference in WHERE clause
17 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
18 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
19 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
20 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
21 CS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Mixed JOINS
22 SS     F         F         F         F         F         F     X     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Mixed JOINS

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.930
2023-02-05
5.0.0.928
2023-02-03
5.0.0.923
2023-02-02
5.0.0.920
2023-01-28
5.0.0.917
2023-01-22
5.0.0.916
2023-01-20
5.0.0.915
2023-01-31
5.0.0.914
2023-01-18
5.0.0.912
2023-01-16
5.0.0.910
2023-01-14
5.0.0.908
2023-01-13
5.0.0.907
2023-01-12
5.0.0.905
2023-01-11
5.0.0.890
2023-01-07
5.0.0.888
2023-01-01
5.0.0.884
2022-12-24
5.0.0.883
2022-12-23
5.0.0.882
2022-12-22
5.0.0.879
2022-12-21
5.0.0.877
2022-12-17
5.0.0.871
2022-12-14
5.0.0.870
2022-12-13
5.0.0.869
2022-12-12
5.0.0.867
2022-12-11
5.0.0.865
2022-12-10
5.0.0.863
2022-12-07
5.0.0.862
2022-12-05
5.0.0.848
2022-11-29
5.0.0.847
2022-11-27
5.0.0.845
2022-11-26
Test TITLE
1 CS 1350 1360 1360 1380 1360 1340 1330 1400 1350 1350 1390 1380 1370 1370 1360 1280 1340 1320 1340 1390 1410 1310 1400 1310 1450 1330 1280 1330 1330 1320
Suboptimal join plan if there are selective non-indexed predicates involved
2 SS 1010 1080 1020 1000 990 1000 1010 990 1010 1020 1010 1000 1030 990 1000 1020 1040 1020 1000 1040 990 1080 1070 1010 1010 990 970 1000 990 990
Suboptimal join plan if there are selective non-indexed predicates involved
3 CS 880 870 910 900 840 830 920 840 870 960 1220 880 900 900 940 1130 1280 880 850 880 840 930 880 900 870 830 780 1220 860 900
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
4 SS 600 610 590 580 600 600 600 610 620 630 610 630 610 580 600 590 610 620 600 650 620 600 620 600 620 580 560 610 600 580
Allow hash/merge joins for non-field (dbkey or derived expression) equalities
5 CS 900 890 1000 980 880 920 850 870 930 920 880 880 950 900 850 830 970 920 890 960 1240 860 900 880 990 930 850 890 900 900
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 SS 630 620 650 680 670 980 640 630 620 1000 660 650 640 630 630 630 640 660 640 630 610 610 650 610 630 630 610 620 610 620
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
7 CS 1800 1800 2000 1840 1810 1820 1780 1770 1770 1840 1790 1770 1780 1840 1880 1770 1820 1830 1790 2560 1790 1810 1810 1930 1800 1770 1000 1790 1950 1790
FULL OUTER JOIN, list all values, but filtered in WHERE clause
8 SS 1550 1640 1660 1540 1540 1530 1540 1640 1540 1560 1550 1530 1730 1780 1540 1520 1540 1550 1560 1560 1530 1000 2100 1980 1560 1530 1510 1550 1530 1560
FULL OUTER JOIN, list all values, but filtered in WHERE clause
9 CS 1790 1800 2170 1830 1760 1780 1770 1900 1780 1790 1780 1800 1780 1800 1830 1000 1880 1780 1810 1830 1780 1790 1830 1800 1780 1800 1000 1790 1770 1780
FULL OUTER JOIN, list all values, but filtered in WHERE clause
10 SS 1550 1550 1740 1530 1630 1530 1520 1640 1670 1550 1550 1550 1550 1520 1520 1530 1560 1540 1560 1580 1640 1000 2080 1560 1560 1540 1520 1540 1530 1570
FULL OUTER JOIN, list all values, but filtered in WHERE clause
11 CS 1790 2170 2190 1780 1760 1770 1780 1780 1820 1800 1790 1780 1780 1780 1810 1730 1820 1770 1770 2290 1830 1780 1810 2360 1880 1790 1920 1790 1780 1000
FULL OUTER JOIN, list all values, but filtered in WHERE clause
12 SS 1550 1550 1560 1550 1520 1560 1520 1780 1540 1540 1550 1540 1550 1520 1550 1520 1560 1560 1570 1560 1530 1000 2130 1620 1550 1540 1510 1550 1740 2050
FULL OUTER JOIN, list all values, but filtered in WHERE clause
13 CS 950 990 960 1090 980 960 950 950 930 890 930 920 990 910 1000 890 980 1010 930 980 940 940 950 950 930 950 840 950 900 960
INNER JOIN join order LIKE and STARTING WITH
14 SS 680 700 690 700 650 680 650 670 680 680 690 680 790 670 650 640 690 690 690 700 660 660 700 660 690 680 640 680 680 690
INNER JOIN join order LIKE and STARTING WITH
15 CS 880 930 890 890 890 930 860 890 900 860 940 910 860 960 930 770 910 850 840 870 950 870 870 880 870 830 760 870 840 930
LEFT OUTER JOIN with full match and reference in WHERE clause
16 SS 620 630 630 620 600 620 610 590 590 630 660 630 630 620 590 610 640 620 650 640 600 620 630 600 630 630 600 650 620 630
LEFT OUTER JOIN with full match and reference in WHERE clause
17 CS 890 970 890 890 840 890 930 910 880 940 900 860 860 930 860 820 880 880 860 960 940 860 970 990 900 890 810 940 900 860
LEFT OUTER JOIN with full match, but limited in ON clause
18 SS 620 630 630 620 590 620 600 590 610 620 710 640 640 630 620 600 620 630 670 620 600 600 630 600 630 610 590 650 600 640
LEFT OUTER JOIN with full match, but limited in ON clause
19 CS 890 890 930 870 900 850 920 920 890 910 890 860 890 910 920 780 940 960 880 910 920 860 880 890 880 860 840 880 880 880
LEFT OUTER JOIN with STARTING WITH in WHERE clause
20 SS 620 630 640 620 620 610 600 590 620 640 640 640 640 620 600 610 630 640 630 640 620 600 630 610 630 610 600 630 610 640
LEFT OUTER JOIN with STARTING WITH in WHERE clause
21 CS 900 1010 890 980 910 880 930 910 890 890 910 890 900 890 920 820 890 920 900 1000 940 960 900 900 880 920 870 900 880 900
Mixed JOINS
22 SS 650 660 660 640 640 650 640 700 650 660 670 640 660 650 650 630 670 650 660 680 640 650 650 660 720 650 630 660 660 670
Mixed JOINS

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2078
http://tracker.firebirdsql.org/browse/core-4528
http://tracker.firebirdsql.org/browse/core-5236
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_full_join_04.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_05.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_mixed_joins_05.fbt

=== end of list ===