0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (3 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (10 rows)
5. Has fails: tests with at least one fail for previous runs (116 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (293 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2124 rows)
9. All tests: durations (3832 rows)
A. Skipped: tests which was intentionally excluded from execution (4 rows)

Generated 17.09.2021 18:35
Tested: HQ30.   Build: 3.0.8.33490;   CS: 17.09.21 17:14:46 - 17.09.21 18:29:56;   SS: 17.09.21 16:07:50 - 17.09.21 17:11:56;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Tests which fail for at least two last runs:
NN Test name mode 3.0.8.33490
2021-09-17
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33471
2021-07-26
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
3.0.8.33452
2021-05-06
3.0.8.33430
2021-04-21
3.0.8.33423
2021-03-30
3.0.8.33415
2021-03-04
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS     F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
2 SS     F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
3 SS     F         F     P     F     P     F         F         F     P     F         F         F     X X X X X X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
4 SS     F         F         F         F         F         F         F         F         F         F         F         E     X X X X X X X X X X X X X X X X X X
Wrong transaction can be passed to external engine
5 CS     F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X X X X X X
INNER JOIN join order
6 SS     F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X X X X X X X X X X X
INNER JOIN join order
7 CS     F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X X X X X X
LEFT OUTER JOIN with full match, but limited in ON clause
8 SS     F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X X X X X X
LEFT OUTER JOIN with full match, but limited in ON clause
9 CS     F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X X X X X X
LEFT OUTER JOIN with STARTING WITH in WHERE clause
10 SS     F         F         F         F         F         F         F     P P P P P X X X X X X X X X X X X X X X X X X
LEFT OUTER JOIN with STARTING WITH in WHERE clause

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33490
2021-09-17
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33471
2021-07-26
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
3.0.8.33452
2021-05-06
3.0.8.33430
2021-04-21
3.0.8.33423
2021-03-30
3.0.8.33415
2021-03-04
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 869 980 869 869 839 730 839 869 1080 919 859 910 889
CREATE COLLATION connection lost under Posix
2 SS 559 579 550 539 629 560 590 529 850 580 549 519 559
CREATE COLLATION connection lost under Posix
3 SS 15665 15909 15819 14559 15279 15519 15279 22789 18589 15710 15620 15000 15960
Performance regression when bulk inserting into table with indices
4 SS 3074 3039 3159 2970 3140 3089 3220 3079 3590 3029 2940 3069 1509
Wrong transaction can be passed to external engine
5 CS 4384 4379 4389 4150 4299 3889 4909 4650 5529 4649 4309 4590 4370
INNER JOIN join order
6 SS 4004 3940 4009 3939 4000 3779 4170 3940 5009 4199 4139 4120 4000
INNER JOIN join order
7 CS 1725 1690 1740 1920 1690 1650 1809 1769 2200 1830 1669 1710 1700
LEFT OUTER JOIN with full match, but limited in ON clause
8 SS 1425 1490 1359 1299 1349 1000 1460 1489 1779 1480 1390 1350 1740
LEFT OUTER JOIN with full match, but limited in ON clause
9 CS 1810 1810 1839 1769 1859 1670 1909 1890 2210 1799 1700 1759 1810
LEFT OUTER JOIN with STARTING WITH in WHERE clause
10 SS 1454 1380 1569 1419 1460 1449 1000 1349 1859 1419 1490 1460 1490
LEFT OUTER JOIN with STARTING WITH in WHERE clause

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5645
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt

=== end of list ===