01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (18 rows)
07. Has fails: tests with at least one fail for previous 30 runs (42 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (608 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (13 rows)
11. All tests: outcomes for previous 30 runs (2663 rows)
12. Skipped: tests which was intentionally excluded from execution (65 rows)

Generated UTC 06.06.2025 13:42
Tested: HQ30.   Build / date: 3.0.13.33809-6638e810 / 2025.05.14;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
3.0.13.33809
2025.05.14
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.04.23
3.0.13.33803
2025.03.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X
Test TITLE
1 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
2 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
3 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
4 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
5 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
6 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
7 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
8 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
9 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
10 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
11 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
12 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
13 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
3.0.13.33809
2025.05.14
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.04.23
3.0.13.33803
2025.03.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X
Test TITLE
1 CS 608 608 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
2 SS 339 339 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
3 CS 587 587 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
4 SS 329 329 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
5 CS 585 585 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
6 SS 334 334 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
7 CS 606 606 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
8 SS 342 342 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
9 CS 598 598 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
10 SS 343 343 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
11 CS 568 568 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
12 SS 343 343 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
13 CS 610 610 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
14 SS 357 357 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
15 CS 574 574 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
16 SS 340 340 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
17 CS 583 583 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
18 SS 360 360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
19 CS 577 577 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
20 SS 327 327 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
21 CS 598 598 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
22 SS 328 328 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
23 CS 607 607 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
24 SS 331 331 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
25 CS 834 834 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
26 SS 341 341 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
=== end of list ===

Last commits information (all timestamps in UTC):