01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (36 rows)
07. Has fails: tests with at least one fail for previous 30 runs (46 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (13 rows)
11. All tests: outcomes for previous 30 runs (2064 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 07.06.2025 13:59
Tested: HQ30.   Build / date: 3.0.13.33809-28ad086f / 2025.05.06;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
3.0.13.33809
2025.05.06
28ad0
3.0.13.33808
2025.04.25
28426
3.0.13.33803
2025.02.25
08ebd
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X X X X X
Test TITLE
1
functional sqlancer arch 2312 17510 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
2
functional sqlancer doi 10 1145 3428279 example 02 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
3
functional sqlancer doi 10 1145 3428279 example 06 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
4
functional sqlancer doi 10 1145 3428279 example 09 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
5
functional sqlancer doi 10 1145 3428279 example 11 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
6
functional sqlancer doi 10 1145 3428279 example 18 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
7
functional sqlancer osdi20 rigger example 05 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
8
functional sqlancer tidb 15844 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
9
functional sqlancer tidb 16028 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
10
functional sqlancer tidb 35522 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
11
functional sqlancer tidb challenge 19 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
12
functional sqlancer tidb challenge 48 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
13
functional tabloid ibp 124 
 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
3.0.13.33809
2025.05.06
28ad0
3.0.13.33808
2025.04.25
28426
3.0.13.33803
2025.02.25
08ebd
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X X X X X
Test TITLE
1
functional sqlancer arch 2312 17510 example 02 
 CS 1191 1191 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
2
functional sqlancer arch 2312 17510 example 02 
 SS 499 499 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
3
functional sqlancer doi 10 1145 3428279 example 02 
 CS 1026 1026 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
4
functional sqlancer doi 10 1145 3428279 example 02 
 SS 566 566 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
5
functional sqlancer doi 10 1145 3428279 example 06 
 CS 1072 1072 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
6
functional sqlancer doi 10 1145 3428279 example 06 
 SS 507 507 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
7
functional sqlancer doi 10 1145 3428279 example 09 
 CS 1129 1129 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
8
functional sqlancer doi 10 1145 3428279 example 09 
 SS 558 558 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
9
functional sqlancer doi 10 1145 3428279 example 11 
 CS 1051 1051 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
10
functional sqlancer doi 10 1145 3428279 example 11 
 SS 573 573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
11
functional sqlancer doi 10 1145 3428279 example 18 
 CS 1038 1038 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
12
functional sqlancer doi 10 1145 3428279 example 18 
 SS 531 531 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
13
functional sqlancer osdi20 rigger example 05 
 CS 1088 1088 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
14
functional sqlancer osdi20 rigger example 05 
 SS 569 569 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
15
functional sqlancer tidb 15844 
 CS 1005 1005 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
16
functional sqlancer tidb 15844 
 SS 506 506 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
17
functional sqlancer tidb 16028 
 CS 1016 1016 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
18
functional sqlancer tidb 16028 
 SS 536 536 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
19
functional sqlancer tidb 35522 
 CS 1019 1019 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
20
functional sqlancer tidb 35522 
 SS 548 548 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
21
functional sqlancer tidb challenge 19 
 CS 1014 1014 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
22
functional sqlancer tidb challenge 19 
 SS 528 528 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
23
functional sqlancer tidb challenge 48 
 CS 1017 1017 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
24
functional sqlancer tidb challenge 48 
 SS 521 521 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
25
functional tabloid ibp 124 
 CS 1042 1042 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
26
functional tabloid ibp 124 
 SS 605 605 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
=== end of list ===

Last commits information (all timestamps in UTC):