01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (9 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (13 rows)
11. All tests: outcomes for previous 30 runs (2025 rows)
12. Skipped: tests which was intentionally excluded from execution (67 rows)

Generated UTC 07.06.2025 03:43
Tested: FB30.   Build / date: 3.0.13.33811-16491678 / 2025.05.07;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN Test name mode
3.0.13.33811
2025.05.07
3.0.13.33810
2025.05.06
3.0.13.33809
2025.05.05
3.0.13.33808
2025.04.18
3.0.13.33807
2025.04.14
3.0.13.33806
2025.03.26
3.0.13.33805
2025.03.17
3.0.13.33804
2025.02.25
3.0.13.33803
2025.01.29
3.0.13.33802
2025.01.28
3.0.13.33800
2025.01.20
3.0.13.33798
2025.01.16
3.0.13.33795
2024.12.23
3.0.13.33794
2024.10.23
3.0.13.33793
2024.09.02
3.0.13.33792
2024.08.30
3.0.13.33791
2024.08.21
3.0.13.33790
2024.08.20
3.0.13.33789
2024.08.09
3.0.12.33787
2024.08.06
3.0.12.33784
2024.08.01
3.0.12.33779
2024.07.31
3.0.12.33778
2024.07.21
3.0.12.33777
2024.07.19
3.0.12.33766
2024.07.13
3.0.12.33765
2024.07.10
3.0.12.33764
2024.06.18
3.0.12.33761
2024.06.17
3.0.12.33758
2024.06.14
3.0.12.33757
2024.06.13
Test TITLE
1 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Bug in RIGHT JOIN
2 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong result of UNION DISTINCT
3 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Failed to fetch a row from a view.
4 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GROUP BY ignores COLLATE with case insensitive attribute
5 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Non-deterministic output when using MAX() function
6 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
7 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result of LIKE.
8 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
9 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
10 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
incorrect unresolved column when using natural join
11 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect result for LEFT JOIN and CASE operator
12 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
13 ALL P X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN Test name mode median_ms
3.0.13.33811
2025.05.07
3.0.13.33810
2025.05.06
3.0.13.33809
2025.05.05
3.0.13.33808
2025.04.18
3.0.13.33807
2025.04.14
3.0.13.33806
2025.03.26
3.0.13.33805
2025.03.17
3.0.13.33804
2025.02.25
3.0.13.33803
2025.01.29
3.0.13.33802
2025.01.28
3.0.13.33800
2025.01.20
3.0.13.33798
2025.01.16
3.0.13.33795
2024.12.23
3.0.13.33794
2024.10.23
3.0.13.33793
2024.09.02
3.0.13.33792
2024.08.30
3.0.13.33791
2024.08.21
3.0.13.33790
2024.08.20
3.0.13.33789
2024.08.09
3.0.12.33787
2024.08.06
3.0.12.33784
2024.08.01
3.0.12.33779
2024.07.31
3.0.12.33778
2024.07.21
3.0.12.33777
2024.07.19
3.0.12.33766
2024.07.13
3.0.12.33765
2024.07.10
3.0.12.33764
2024.06.18
3.0.12.33761
2024.06.17
3.0.12.33758
2024.06.14
3.0.12.33757
2024.06.13
Test TITLE
1 CS 840 840 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
2 SS 508 508 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bug in RIGHT JOIN
3 CS 814 814 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
4 SS 536 536 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong result of UNION DISTINCT
5 CS 807 807 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
6 SS 488 488 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Failed to fetch a row from a view.
7 CS 789 789 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
8 SS 487 487 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
GROUP BY ignores COLLATE with case insensitive attribute
9 CS 776 776 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
10 SS 482 482 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-deterministic output when using MAX() function
11 CS 781 781 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
12 SS 426 426 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
13 CS 877 877 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
14 SS 498 498 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result of LIKE.
15 CS 803 803 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
16 SS 457 457 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
17 CS 812 812 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
18 SS 460 460 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
19 CS 755 755 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
20 SS 449 449 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
incorrect unresolved column when using natural join
21 CS 806 806 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
22 SS 518 518 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect result for LEFT JOIN and CASE operator
23 CS 754 754 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
24 SS 515 515 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
25 CS 788 788 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
26 SS 448 448 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py
=== end of list ===

Last commits information (all timestamps in UTC):