01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (6 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (49 rows)
07. Has fails: tests with at least one fail for previous 30 runs (51 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (24 rows)
11. All tests: outcomes for previous 30 runs (2478 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 07.06.2025 11:45
Tested: HQ40.   Build / date: 4.0.6.3189-1a1a50e4 / 2025.02.25;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X
Test TITLE
1
bugs gh 8429 
 tracker
 SS P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Segfault when already destroyed callback interface is used
2
bugs gh 8508 
 tracker
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Conversion Error with old.field in UPDATE OR INSERT
3
functional gtcs isql one line comments 01 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
bug #781610 problems with one line comments (--)
4
functional intl non ascii firebird and trace utf8 
 CS P F F F F F F F F X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
5
functional intl non ascii firebird and trace utf8 
 SS P F F F F F F F F X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
6
functional sqlancer arch 2312 17510 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
7
functional sqlancer doi 10 1145 3428279 example 01 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
predicate 0 = -0 to incorrectly evaluate to FALSE.
8
functional sqlancer doi 10 1145 3428279 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
9
functional sqlancer doi 10 1145 3428279 example 04 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of AVG evaluation as result of SUM / COUNT
10
functional sqlancer doi 10 1145 3428279 example 06 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
11
functional sqlancer doi 10 1145 3428279 example 09 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
12
functional sqlancer doi 10 1145 3428279 example 10 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnexpectedly optimized VARIANCE(0) to FALSE
13
functional sqlancer doi 10 1145 3428279 example 11 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
14
functional sqlancer doi 10 1145 3428279 example 17 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Conversion of character string to boolean value
15
functional sqlancer doi 10 1145 3428279 example 18 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
16
functional sqlancer osdi20 rigger example 05 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
17
functional sqlancer osdi20 rigger example 12 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Unexpected null value when index is used
18
functional sqlancer tidb 15844 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
19
functional sqlancer tidb 16028 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
20
functional sqlancer tidb 35522 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
21
functional sqlancer tidb challenge 19 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
22
functional sqlancer tidb challenge 48 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
23
functional tabloid 3123a5a0 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Check ability to reuse internal connection by EXECUTE STATEMENT.
24
functional tabloid ibp 124 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X
Test TITLE
1
bugs gh 8429 
 tracker
 SS 2304 3068 1540 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Segfault when already destroyed callback interface is used
2
bugs gh 8508 
 tracker
 CS 663 663 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion Error with old.field in UPDATE OR INSERT
3
bugs gh 8508 
 tracker
 SS 481 481 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion Error with old.field in UPDATE OR INSERT
4
functional gtcs isql one line comments 01 
 CS 723 723 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
bug #781610 problems with one line comments (--)
5
functional gtcs isql one line comments 01 
 SS 503 503 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
bug #781610 problems with one line comments (--)
6
functional intl non ascii firebird and trace utf8 
 CS 573 3928 656 682 691 545 517 524 506 573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
7
functional intl non ascii firebird and trace utf8 
 SS 363 3436 431 474 443 324 363 362 342 363 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
8
functional sqlancer arch 2312 17510 example 02 
 CS 680 680 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
9
functional sqlancer arch 2312 17510 example 02 
 SS 541 541 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
10
functional sqlancer doi 10 1145 3428279 example 01 
 CS 752 752 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
11
functional sqlancer doi 10 1145 3428279 example 01 
 SS 479 479 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
predicate 0 = -0 to incorrectly evaluate to FALSE.
12
functional sqlancer doi 10 1145 3428279 example 02 
 CS 739 739 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
13
functional sqlancer doi 10 1145 3428279 example 02 
 SS 496 496 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
14
functional sqlancer doi 10 1145 3428279 example 04 
 CS 666 666 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
15
functional sqlancer doi 10 1145 3428279 example 04 
 SS 463 463 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of AVG evaluation as result of SUM / COUNT
16
functional sqlancer doi 10 1145 3428279 example 06 
 CS 744 744 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
17
functional sqlancer doi 10 1145 3428279 example 06 
 SS 458 458 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
18
functional sqlancer doi 10 1145 3428279 example 09 
 CS 734 734 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
19
functional sqlancer doi 10 1145 3428279 example 09 
 SS 565 565 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
20
functional sqlancer doi 10 1145 3428279 example 10 
 CS 712 712 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
21
functional sqlancer doi 10 1145 3428279 example 10 
 SS 485 485 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnexpectedly optimized VARIANCE(0) to FALSE
22
functional sqlancer doi 10 1145 3428279 example 11 
 CS 717 717 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
23
functional sqlancer doi 10 1145 3428279 example 11 
 SS 534 534 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
24
functional sqlancer doi 10 1145 3428279 example 17 
 CS 677 677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
25
functional sqlancer doi 10 1145 3428279 example 17 
 SS 468 468 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Conversion of character string to boolean value
26
functional sqlancer doi 10 1145 3428279 example 18 
 CS 751 751 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
27
functional sqlancer doi 10 1145 3428279 example 18 
 SS 474 474 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
28
functional sqlancer osdi20 rigger example 05 
 CS 709 709 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
29
functional sqlancer osdi20 rigger example 05 
 SS 524 524 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
30
functional sqlancer osdi20 rigger example 12 
 CS 788 788 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
31
functional sqlancer osdi20 rigger example 12 
 SS 507 507 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unexpected null value when index is used
32
functional sqlancer tidb 15844 
 CS 724 724 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
33
functional sqlancer tidb 15844 
 SS 546 546 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
34
functional sqlancer tidb 16028 
 CS 675 675 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
35
functional sqlancer tidb 16028 
 SS 522 522 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
36
functional sqlancer tidb 35522 
 CS 673 673 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
37
functional sqlancer tidb 35522 
 SS 488 488 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
38
functional sqlancer tidb challenge 19 
 CS 749 749 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
39
functional sqlancer tidb challenge 19 
 SS 523 523 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
40
functional sqlancer tidb challenge 48 
 CS 706 706 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
41
functional sqlancer tidb challenge 48 
 SS 540 540 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
42
functional tabloid 3123a5a0 
 CS 750 750 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to reuse internal connection by EXECUTE STATEMENT.
43
functional tabloid 3123a5a0 
 SS 482 482 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to reuse internal connection by EXECUTE STATEMENT.
44
functional tabloid ibp 124 
 CS 702 702 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
45
functional tabloid ibp 124 
 SS 546 546 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_isql_one_line_comments_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intl/test_non_ascii_firebird_and_trace_utf8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_04_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_10_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_17_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_12_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_3123a5a0.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
https://github.com/FirebirdSQL/firebird/issues/8429
https://github.com/FirebirdSQL/firebird/issues/8508
=== end of list ===

Last commits information (all timestamps in UTC):