0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (36 rows)
2. FRESH FAILS: tests which failed for LAST execution only (4 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (9 rows)
5. Has fails: tests with at least one fail for previous runs (96 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (12 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (4 rows)
8. All tests: outcomes (1993 rows)
9. All tests: durations (3862 rows)
A. Skipped: tests which was intentionally excluded from execution (5 rows)

Generated 27.09.2021 07:54
Tested: HQ30.   Build: 3.0.8.33501;   CS: 27.09.21 05:46:21 - 27.09.21 07:47:18;   SS: 27.09.21 04:34:48 - 27.09.21 05:44:56;
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Tests which fail for at least two last runs:
NN Test name mode 3.0.8.33501
2021-09-27		 3.0.8.33490
2021-09-22		 3.0.8.33489
2021-08-10		 3.0.8.33488
2021-08-07		 3.0.8.33487
2021-07-31		 3.0.8.33475
2021-07-20		 3.0.8.33472
2021-06-18		 3.0.8.33471
2021-06-09		 3.0.8.33470
2021-06-02		 3.0.8.33468
2021-05-29		 3.0.8.33452
2021-05-13		 3.0.8.33430
2021-04-17		 3.0.8.33423
2021-03-30		 3.0.8.33415
2021-03-04		 3.0.8.33403
2021-01-27		 3.0.8.33392
2021-01-17		 3.0.7.33388
2021-01-17		 3.0.7.33379
2021-01-18		 3.0.7.33375
2021-01-18		 3.0.7.33368
2021-01-18		 3.0.7.33358
2021-01-18		 3.0.7.33356
2021-01-18		 3.0.7.33352
2021-01-18		 3.0.7.33350
2021-01-19		 3.0.7.33348
2021-01-19		 3.0.7.33343
2021-01-19		 3.0.6.33332
2021-01-20		 3.0.6.33331
2021-01-20		 3.0.6.33292
2021-01-20		 3.0.6.33289
2021-01-21
Test TITLE
1
bugs core 2484
tracker
 CS     F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Success message when connecting to tiny trash database file
2
bugs core 2484
tracker
 SS     F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Success message when connecting to tiny trash database file
3
bugs core 5645
tracker
 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P
Wrong transaction can be passed to external engine
4
optimizer opt inner join 03
 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
5
optimizer opt inner join 03
 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
6
optimizer opt left join 06
 CS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
LEFT OUTER JOIN with full match, but limited in ON clause
7
optimizer opt left join 06
 SS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
LEFT OUTER JOIN with full match, but limited in ON clause
8
optimizer opt left join 11
 CS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
LEFT OUTER JOIN with STARTING WITH in WHERE clause
9
optimizer opt left join 11
 SS     F         F         F         F         F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P
LEFT OUTER JOIN with STARTING WITH in WHERE clause

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33501
2021-09-27		 3.0.8.33490
2021-09-22		 3.0.8.33489
2021-08-10		 3.0.8.33488
2021-08-07		 3.0.8.33487
2021-07-31		 3.0.8.33475
2021-07-20		 3.0.8.33472
2021-06-18		 3.0.8.33471
2021-06-09		 3.0.8.33470
2021-06-02		 3.0.8.33468
2021-05-29		 3.0.8.33452
2021-05-13		 3.0.8.33430
2021-04-17		 3.0.8.33423
2021-03-30		 3.0.8.33415
2021-03-04		 3.0.8.33403
2021-01-27		 3.0.8.33392
2021-01-17		 3.0.7.33388
2021-01-17		 3.0.7.33379
2021-01-18		 3.0.7.33375
2021-01-18		 3.0.7.33368
2021-01-18		 3.0.7.33358
2021-01-18		 3.0.7.33356
2021-01-18		 3.0.7.33352
2021-01-18		 3.0.7.33350
2021-01-19		 3.0.7.33348
2021-01-19		 3.0.7.33343
2021-01-19		 3.0.6.33332
2021-01-20		 3.0.6.33331
2021-01-20		 3.0.6.33292
2021-01-20		 3.0.6.33289
2021-01-21
Test TITLE
1
bugs core 2484
tracker
 CS 3220 3650 4119 3720 3680 3660 3690 3509 3620 3529 3409 3210 3349 3000 3289 3230 3259 3190 3070 3190 3140 3029 3360 3190 2920 2849 2799 2650 2809 2890 2829
Success message when connecting to tiny trash database file
2
bugs core 2484
tracker
 SS 2309 2579 2590 2570 2590 2559 2629 2529 2529 2509 2400 2390 2439 2390 2289 2329 2059 2330 2119 2029 2070 2170 2090 2140 2100 1980 1970 1900 1940 1970 1970
Success message when connecting to tiny trash database file
3
bugs core 5645
tracker
 SS 2970 3279 3259 3330 3390 3289 3349 3290 3350 3319 3259 3099 3160 3130 3019 2980 2170 2100 2000 2079 2960 2259 2390 2119 1809 1720 1670 1730 1640 1599 1640
Wrong transaction can be passed to external engine
4
optimizer opt inner join 03
 CS 2569 2879 2630 2579 2630 2000 2549 2590 2549 2660 2630 2559 2529 2480 2440 2310 3159 3160 3119 3069 2920 3000 2850 2950 2360 2279 2240 2470 2159 2450 2170
INNER JOIN join order
5
optimizer opt inner join 03
 SS 1879 1980 2000 1899 1890 1869 1809 1799 1910 1869 1940 1940 1839 1000 1740 1810 2240 2370 2169 2099 1990 2089 2089 1990 1589 1759 1670 1860 1690 1779 1590
INNER JOIN join order
6
optimizer opt left join 06
 CS 2054 3180 2240 2190 2159 2170 2169 2270 2000 2220 2139 2009 2080 2069 2019 1980 2029 2290 2009 2059 2049 1830 2190 1969 1519 1519 1460 1470 1490 3539 1519
LEFT OUTER JOIN with full match, but limited in ON clause
7
optimizer opt left join 06
 SS 1235 1470 1450 1460 1449 1460 1450 1000 1000 1000 1470 1390 1439 1470 1359 1449 1230 1269 1170 1210 1330 1160 1129 1180 939 899 910 980 949 950 1240
LEFT OUTER JOIN with full match, but limited in ON clause
8
optimizer opt left join 11
 CS 2054 10390 2000 2000 2149 2160 2170 2000 2259 2200 2150 2009 2059 2129 2109 1920 2140 3039 2059 2050 2039 1850 2140 2059 1549 1969 1410 1569 1759 1579 1629
LEFT OUTER JOIN with STARTING WITH in WHERE clause
9
optimizer opt left join 11
 SS 1249 1450 1429 1470 1460 1440 1450 1480 1000 1000 1529 1419 1480 1399 1410 1430 1289 1099 1210 1140 1029 1200 1310 1159 879 939 919 929 1090 970 1170
LEFT OUTER JOIN with STARTING WITH in WHERE clause

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2484
http://tracker.firebirdsql.org/browse/core-5645
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt

=== end of list ===