01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (19 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (3 rows)
07. Has fails: tests with at least one fail for previous 30 runs (92 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (20 rows)
11. All tests: outcomes for previous 30 runs (3408 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 06.06.2025 10:15
Tested: HQ50.   Build / date: 5.0.3.1656-00512501 / 2025.06.05;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
Test TITLE
1 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
2 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
3 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
predicate 0 = -0 to incorrectly evaluate to FALSE.
4 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
5 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of AVG evaluation as result of SUM / COUNT
6 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
7 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
8 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnexpectedly optimized VARIANCE(0) to FALSE
9 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
10 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong evaluation of MIN when bitwise shift is applied to the source value
11 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Conversion of character string to boolean value
12 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
13 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
14 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
15 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unexpected null value when index is used
16 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
17 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
18 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
19 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
20 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
Test TITLE
1 CS 586 586 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
2 SS 376 376 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
3 CS 614 614 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
4 SS 372 372 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
5 CS 575 575 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
6 SS 374 374 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
7 CS 579 579 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
8 SS 393 393 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
9 CS 578 578 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
10 SS 373 373 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
11 CS 579 579 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
12 SS 393 393 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
13 CS 630 630 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
14 SS 390 390 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
15 CS 605 605 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
16 SS 374 374 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
17 CS 588 588 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
18 SS 375 375 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
19 CS 611 611 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong evaluation of MIN when bitwise shift is applied to the source value
20 SS 376 376 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong evaluation of MIN when bitwise shift is applied to the source value
21 CS 578 578 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
22 SS 386 386 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
23 CS 593 593 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
24 SS 371 371 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
25 CS 591 591 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
26 SS 378 378 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
27 CS 607 607 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
28 SS 390 390 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
29 CS 597 597 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
30 SS 392 392 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
31 CS 580 580 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
32 SS 388 388 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
33 CS 615 615 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
34 SS 382 382 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
35 CS 588 588 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
36 SS 375 375 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
37 CS 589 589 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
38 SS 373 373 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
39 CS 597 597 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
40 SS 380 380 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_04_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_10_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_15_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_17_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_12_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
=== end of list ===

Last commits information (all timestamps in UTC):