01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
[CURRENT] 03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
06. Has fails: tests with at least one fail for previous 30 runs (66 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (6 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (4 rows)
10. All tests: outcomes for previous 30 runs (2024 rows)
11. All tests: durations for previous 30 runs (3966 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 26.03.2024 14:03
Tested: HQ30.   Build: 3.0.12.33726;   SS: 26.03.24 12:43:52 - 26.03.24 13:13:44;   CS: 26.03.24 13:14:35 - 26.03.24 14:01:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Tests with result = "FAIL" for last run:

NN Test name mode 3.0.12.33726
2024-03-26
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS F P F F P P P F F F F F F X X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
2 CS F P P P P P P P P P P P P X X X X X X X X X X X X X X X X X
INNER JOIN join order
3 SS F P P P P P P P P P P P P X X X X X X X X X X X X X X X X X
INNER JOIN join order

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33726
2024-03-26
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 179258 147337 199542 176102 181437 193014 192599 187706 166446 178724 185588 179258 175770 114084 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Better performance of creating packages containing many functions
2 CS 972 972 1124 964 1093 1066 1037 1021 885 951 962 876 1121 916 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order
3 SS 654 516 680 596 593 687 716 674 539 618 667 654 722 589 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-4880
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_03.py

=== end of list ===