01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (12 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (19 rows)
11. All tests: outcomes for previous 30 runs (2461 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 06.06.2025 07:55
Tested: FB40.   Build / date: 4.0.6.3206-d7d100d1 / 2025.05.22;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
4.0.6.3174
2024.12.23
4.0.6.3173
2024.12.19
4.0.6.3172
2024.12.11
4.0.6.3171
2024.12.10
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
Test TITLE
1 SS P F P F P P P P P P F F P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
3 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
predicate 0 = -0 to incorrectly evaluate to FALSE.
4 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
5 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of AVG evaluation as result of SUM / COUNT
6 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
7 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
8 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnexpectedly optimized VARIANCE(0) to FALSE
9 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
10 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Conversion of character string to boolean value
11 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
12 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
13 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unexpected null value when index is used
14 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
15 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
16 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
17 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
18 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
19 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
4.0.6.3174
2024.12.23
4.0.6.3173
2024.12.19
4.0.6.3172
2024.12.11
4.0.6.3171
2024.12.10
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
Test TITLE
1 SS 488 51269 51643 49604 50312 47109 49860 43751 42335 48338 49307 468 481 496 446 491 459 483 481 476 486 495 463 527 483 503 395 394 386 386 372
Compress Data over the Network
2 CS 672 672 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
3 SS 511 511 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
4 CS 645 645 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
5 SS 499 499 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
6 CS 690 690 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
7 SS 552 552 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
8 CS 762 762 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
9 SS 498 498 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
10 CS 664 664 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
11 SS 477 477 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
12 CS 791 791 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
13 SS 488 488 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
14 CS 680 680 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
15 SS 507 507 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
16 CS 714 714 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
17 SS 500 500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
18 CS 698 698 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
19 SS 472 472 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
20 CS 694 694 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
21 SS 448 448 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
22 CS 657 657 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
23 SS 558 558 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
24 CS 746 746 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
25 SS 488 488 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
26 CS 748 748 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
27 SS 464 464 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
28 CS 749 749 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
29 SS 456 456 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
30 CS 695 695 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
31 SS 492 492 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
32 CS 766 766 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
33 SS 464 464 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
34 CS 744 744 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
35 SS 437 437 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
36 CS 667 667 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
37 SS 457 457 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_04_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_10_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_17_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_12_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
=== end of list ===

Last commits information (all timestamps in UTC):