01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (3 rows)
07. Has fails: tests with at least one fail for previous 30 runs (9 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (19 rows)
11. All tests: outcomes for previous 30 runs (2478 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 06.06.2025 06:52
Tested: FB40.   Build / date: 4.0.6.3206-d7d100d1 / 2025.05.22;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
4.0.6.3206
2025.05.22
d7d10
4.0.6.3205
2025.05.07
00148
4.0.6.3204
2025.05.06
35b85
4.0.6.3203
2025.05.05
c2cbd
4.0.6.3200
2025.04.18
7ef56
4.0.6.3199
2025.04.14
33a10
4.0.6.3198
2025.04.13
64a7f
4.0.6.3195
2025.04.12
82cb5
4.0.6.3195
2025.03.28
b9faf
4.0.6.3194
2025.03.27
ab754
4.0.6.3194
2025.03.26
912aa
4.0.6.3193
2025.03.20
80234
4.0.6.3192
2025.03.13
2a9da
4.0.6.3191
2025.03.10
3d9fd
4.0.6.3190
2025.02.25
c9928
4.0.6.3189
2025.02.22
3fb0b
4.0.6.3188
2025.02.21
8ee1c
4.0.6.3186
2025.02.19
92cb6
4.0.6.3185
2025.02.16
9cac4
4.0.6.3183
2025.02.04
bf738
4.0.6.3181
2025.02.01
00b64
4.0.6.3180
2025.01.27
2edb8
4.0.6.3179
2025.01.24
008d4
4.0.6.3178
2025.01.20
ec94d
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
Test TITLE
1
bugs gh 6802 
 tracker
 CS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
2
functional sqlancer arch 2312 17510 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
3
functional sqlancer doi 10 1145 3428279 example 01 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
predicate 0 = -0 to incorrectly evaluate to FALSE.
4
functional sqlancer doi 10 1145 3428279 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
5
functional sqlancer doi 10 1145 3428279 example 04 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of AVG evaluation as result of SUM / COUNT
6
functional sqlancer doi 10 1145 3428279 example 06 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
7
functional sqlancer doi 10 1145 3428279 example 09 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
8
functional sqlancer doi 10 1145 3428279 example 10 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnexpectedly optimized VARIANCE(0) to FALSE
9
functional sqlancer doi 10 1145 3428279 example 11 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
10
functional sqlancer doi 10 1145 3428279 example 17 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Conversion of character string to boolean value
11
functional sqlancer doi 10 1145 3428279 example 18 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
12
functional sqlancer osdi20 rigger example 05 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
13
functional sqlancer osdi20 rigger example 12 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unexpected null value when index is used
14
functional sqlancer tidb 15844 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
15
functional sqlancer tidb 16028 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
16
functional sqlancer tidb 35522 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
17
functional sqlancer tidb challenge 19 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
18
functional sqlancer tidb challenge 48 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
19
functional tabloid ibp 124 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3206
2025.05.22
d7d10
4.0.6.3205
2025.05.07
00148
4.0.6.3204
2025.05.06
35b85
4.0.6.3203
2025.05.05
c2cbd
4.0.6.3200
2025.04.18
7ef56
4.0.6.3199
2025.04.14
33a10
4.0.6.3198
2025.04.13
64a7f
4.0.6.3195
2025.04.12
82cb5
4.0.6.3195
2025.03.28
b9faf
4.0.6.3194
2025.03.27
ab754
4.0.6.3194
2025.03.26
912aa
4.0.6.3193
2025.03.20
80234
4.0.6.3192
2025.03.13
2a9da
4.0.6.3191
2025.03.10
3d9fd
4.0.6.3190
2025.02.25
c9928
4.0.6.3189
2025.02.22
3fb0b
4.0.6.3188
2025.02.21
8ee1c
4.0.6.3186
2025.02.19
92cb6
4.0.6.3185
2025.02.16
9cac4
4.0.6.3183
2025.02.04
bf738
4.0.6.3181
2025.02.01
00b64
4.0.6.3180
2025.01.27
2edb8
4.0.6.3179
2025.01.24
008d4
4.0.6.3178
2025.01.20
ec94d
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
Test TITLE
1
bugs gh 6802 
 tracker
 CS 21679 21705 21954 21668 21676 21770 21672 21673 21641 21890 21656 21671 22113 21675 21679 21706 21783 21660 21681 21662 21665 21699 21663 21680 21694 21670 22262 21979 21680 21655 21683
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
2
functional sqlancer arch 2312 17510 example 02 
 CS 626 626 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
3
functional sqlancer arch 2312 17510 example 02 
 SS 398 398 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
4
functional sqlancer doi 10 1145 3428279 example 01 
 CS 655 655 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
5
functional sqlancer doi 10 1145 3428279 example 01 
 SS 407 407 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
6
functional sqlancer doi 10 1145 3428279 example 02 
 CS 631 631 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
7
functional sqlancer doi 10 1145 3428279 example 02 
 SS 415 415 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
8
functional sqlancer doi 10 1145 3428279 example 04 
 CS 651 651 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
9
functional sqlancer doi 10 1145 3428279 example 04 
 SS 414 414 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
10
functional sqlancer doi 10 1145 3428279 example 06 
 CS 671 671 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
11
functional sqlancer doi 10 1145 3428279 example 06 
 SS 450 450 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
12
functional sqlancer doi 10 1145 3428279 example 09 
 CS 626 626 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
13
functional sqlancer doi 10 1145 3428279 example 09 
 SS 411 411 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
14
functional sqlancer doi 10 1145 3428279 example 10 
 CS 636 636 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
15
functional sqlancer doi 10 1145 3428279 example 10 
 SS 405 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
16
functional sqlancer doi 10 1145 3428279 example 11 
 CS 603 603 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
17
functional sqlancer doi 10 1145 3428279 example 11 
 SS 424 424 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
18
functional sqlancer doi 10 1145 3428279 example 17 
 CS 603 603 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
19
functional sqlancer doi 10 1145 3428279 example 17 
 SS 450 450 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
20
functional sqlancer doi 10 1145 3428279 example 18 
 CS 594 594 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
21
functional sqlancer doi 10 1145 3428279 example 18 
 SS 424 424 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
22
functional sqlancer osdi20 rigger example 05 
 CS 645 645 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
23
functional sqlancer osdi20 rigger example 05 
 SS 432 432 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
24
functional sqlancer osdi20 rigger example 12 
 CS 619 619 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
25
functional sqlancer osdi20 rigger example 12 
 SS 422 422 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
26
functional sqlancer tidb 15844 
 CS 623 623 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
27
functional sqlancer tidb 15844 
 SS 405 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
28
functional sqlancer tidb 16028 
 CS 601 601 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
29
functional sqlancer tidb 16028 
 SS 405 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
30
functional sqlancer tidb 35522 
 CS 590 590 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
31
functional sqlancer tidb 35522 
 SS 409 409 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
32
functional sqlancer tidb challenge 19 
 CS 598 598 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
33
functional sqlancer tidb challenge 19 
 SS 413 413 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
34
functional sqlancer tidb challenge 48 
 CS 601 601 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
35
functional sqlancer tidb challenge 48 
 SS 406 406 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
36
functional tabloid ibp 124 
 CS 624 624 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
37
functional tabloid ibp 124 
 SS 404 404 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_04_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_10_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_17_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_12_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
https://github.com/FirebirdSQL/firebird/issues/6802
=== end of list ===

Last commits information (all timestamps in UTC):