nix-5x new_passed

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (8 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
[CURRENT] 10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (21 rows)
11. All tests: outcomes for previous 30 runs (2609 rows)
12. Skipped: tests which was intentionally excluded from execution (77 rows)

Generated UTC 06.06.2025 04:50
Tested: FB50. Build / date: 5.0.3.1659-f4c0f85d / 2025.05.28;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "PASSED" after previous outcome = FAIL/ERROR/SKIPPED or absent:

NN	Test name	mode	5.0.3.1659 2025.05.28 f4c0f	5.0.3.1658 2025.05.27 e3aa4	5.0.3.1657 2025.05.22 a6c19	5.0.3.1656 2025.05.12 37a12	5.0.3.1654 2025.05.11 789ca	5.0.3.1653 2025.05.07 8e48a	5.0.3.1652 2025.05.06 1de2f	5.0.3.1651 2025.05.05 c8191	5.0.3.1650 2025.04.23 41dca	5.0.3.1649 2025.04.18 da7bd	5.0.3.1648 2025.04.17 a54ad	5.0.3.1647 2025.04.14 8993a	5.0.3.1646 2025.04.13 60c64	5.0.3.1643 2025.04.11 a5179	5.0.3.1642 2025.04.09 9dc39	5.0.3.1641 2025.04.02 59e25	5.0.3.1639 2025.03.31 67152	5.0.3.1638 2025.03.28 6579c	5.0.3.1636 2025.03.26 725be	5.0.3.1635 2025.03.24 9363e	5.0.3.1634 2025.03.20 be406	5.0.3.1632 2025.03.13 10216	5.0.3.1631 2025.03.12 34a04	5.0.3.1630 2025.03.07 81e0d	5.0.3.1629 2025.03.05 a6fa2	5.0.3.1628 2025.03.04 d7ecb	5.0.3.1627 2025.02.26 5e33d	5.0.3.1626 2025.02.25 2d71d	5.0.3.1624 2025.02.24 b01e1	5.0.3.1622 2025.02.22 c1a51	Test TITLE
1	functional sqlancer arch 2312 17510 example 01	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
2	functional sqlancer arch 2312 17510 example 02	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Bug in RIGHT JOIN
3	functional sqlancer doi 10 1145 3428279 example 01	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	predicate 0 = -0 to incorrectly evaluate to FALSE.
4	functional sqlancer doi 10 1145 3428279 example 02	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Wrong result of UNION DISTINCT
5	functional sqlancer doi 10 1145 3428279 example 04	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Wrong result of AVG evaluation as result of SUM / COUNT
6	functional sqlancer doi 10 1145 3428279 example 06	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Failed to fetch a row from a view.
7	functional sqlancer doi 10 1145 3428279 example 09	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	GROUP BY ignores COLLATE with case insensitive attribute
8	functional sqlancer doi 10 1145 3428279 example 10	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Unnexpectedly optimized VARIANCE(0) to FALSE
9	functional sqlancer doi 10 1145 3428279 example 11	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Non-deterministic output when using MAX() function
10	functional sqlancer doi 10 1145 3428279 example 15	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Wrong evaluation of MIN when bitwise shift is applied to the source value
11	functional sqlancer doi 10 1145 3428279 example 17	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Conversion of character string to boolean value
12	functional sqlancer doi 10 1145 3428279 example 18	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Comparison of string and numeric literals
13	functional sqlancer osdi20 rigger example 01	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
14	functional sqlancer osdi20 rigger example 05	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Incorrect result of LIKE.
15	functional sqlancer osdi20 rigger example 12	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Unexpected null value when index is used
16	functional sqlancer tidb 15844	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
17	functional sqlancer tidb 16028	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
18	functional sqlancer tidb 35522	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	incorrect unresolved column when using natural join
19	functional sqlancer tidb challenge 19	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Incorrect result for LEFT JOIN and CASE operator
20	functional sqlancer tidb challenge 48	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
21	functional tabloid ibp 124	ALL	P	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

Elapsed time, milliseconds:

NN	Test name	mode	median_ms	5.0.3.1659 2025.05.28 f4c0f	5.0.3.1658 2025.05.27 e3aa4	5.0.3.1657 2025.05.22 a6c19	5.0.3.1656 2025.05.12 37a12	5.0.3.1654 2025.05.11 789ca	5.0.3.1653 2025.05.07 8e48a	5.0.3.1652 2025.05.06 1de2f	5.0.3.1651 2025.05.05 c8191	5.0.3.1650 2025.04.23 41dca	5.0.3.1649 2025.04.18 da7bd	5.0.3.1648 2025.04.17 a54ad	5.0.3.1647 2025.04.14 8993a	5.0.3.1646 2025.04.13 60c64	5.0.3.1643 2025.04.11 a5179	5.0.3.1642 2025.04.09 9dc39	5.0.3.1641 2025.04.02 59e25	5.0.3.1639 2025.03.31 67152	5.0.3.1638 2025.03.28 6579c	5.0.3.1636 2025.03.26 725be	5.0.3.1635 2025.03.24 9363e	5.0.3.1634 2025.03.20 be406	5.0.3.1632 2025.03.13 10216	5.0.3.1631 2025.03.12 34a04	5.0.3.1630 2025.03.07 81e0d	5.0.3.1629 2025.03.05 a6fa2	5.0.3.1628 2025.03.04 d7ecb	5.0.3.1627 2025.02.26 5e33d	5.0.3.1626 2025.02.25 2d71d	5.0.3.1624 2025.02.24 b01e1	5.0.3.1622 2025.02.22 c1a51	Test TITLE
1	functional sqlancer arch 2312 17510 example 01	CS	826	826	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
2	functional sqlancer arch 2312 17510 example 01	SS	428	428	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	PARTIAL INDICES. NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
3	functional sqlancer arch 2312 17510 example 02	CS	836	836	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Bug in RIGHT JOIN
4	functional sqlancer arch 2312 17510 example 02	SS	476	476	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Bug in RIGHT JOIN
5	functional sqlancer doi 10 1145 3428279 example 01	CS	793	793	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	predicate 0 = -0 to incorrectly evaluate to FALSE.
6	functional sqlancer doi 10 1145 3428279 example 01	SS	478	478	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	predicate 0 = -0 to incorrectly evaluate to FALSE.
7	functional sqlancer doi 10 1145 3428279 example 02	CS	767	767	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong result of UNION DISTINCT
8	functional sqlancer doi 10 1145 3428279 example 02	SS	489	489	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong result of UNION DISTINCT
9	functional sqlancer doi 10 1145 3428279 example 04	CS	773	773	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong result of AVG evaluation as result of SUM / COUNT
10	functional sqlancer doi 10 1145 3428279 example 04	SS	448	448	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong result of AVG evaluation as result of SUM / COUNT
11	functional sqlancer doi 10 1145 3428279 example 06	CS	829	829	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Failed to fetch a row from a view.
12	functional sqlancer doi 10 1145 3428279 example 06	SS	503	503	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Failed to fetch a row from a view.
13	functional sqlancer doi 10 1145 3428279 example 09	CS	848	848	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	GROUP BY ignores COLLATE with case insensitive attribute
14	functional sqlancer doi 10 1145 3428279 example 09	SS	501	501	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	GROUP BY ignores COLLATE with case insensitive attribute
15	functional sqlancer doi 10 1145 3428279 example 10	CS	821	821	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Unnexpectedly optimized VARIANCE(0) to FALSE
16	functional sqlancer doi 10 1145 3428279 example 10	SS	439	439	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Unnexpectedly optimized VARIANCE(0) to FALSE
17	functional sqlancer doi 10 1145 3428279 example 11	CS	819	819	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Non-deterministic output when using MAX() function
18	functional sqlancer doi 10 1145 3428279 example 11	SS	468	468	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Non-deterministic output when using MAX() function
19	functional sqlancer doi 10 1145 3428279 example 15	CS	800	800	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong evaluation of MIN when bitwise shift is applied to the source value
20	functional sqlancer doi 10 1145 3428279 example 15	SS	458	458	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Wrong evaluation of MIN when bitwise shift is applied to the source value
21	functional sqlancer doi 10 1145 3428279 example 17	CS	811	811	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Conversion of character string to boolean value
22	functional sqlancer doi 10 1145 3428279 example 17	SS	430	430	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Conversion of character string to boolean value
23	functional sqlancer doi 10 1145 3428279 example 18	CS	779	779	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Comparison of string and numeric literals
24	functional sqlancer doi 10 1145 3428279 example 18	SS	436	436	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Comparison of string and numeric literals
25	functional sqlancer osdi20 rigger example 01	CS	842	842	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
26	functional sqlancer osdi20 rigger example 01	SS	422	422	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Partial index must not use incorrect assumption that 'c0 IS NOT 1' implied 'c0 NOT NULL'
27	functional sqlancer osdi20 rigger example 05	CS	817	817	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result of LIKE.
28	functional sqlancer osdi20 rigger example 05	SS	470	470	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result of LIKE.
29	functional sqlancer osdi20 rigger example 12	CS	816	816	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Unexpected null value when index is used
30	functional sqlancer osdi20 rigger example 12	SS	530	530	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Unexpected null value when index is used
31	functional sqlancer tidb 15844	CS	721	721	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
32	functional sqlancer tidb 15844	SS	434	434	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	NATURAL RIGHT JOIN results in an unexpected "Unknown column" error
33	functional sqlancer tidb 16028	CS	780	780	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
34	functional sqlancer tidb 16028	SS	469	469	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result when comparing a FLOAT/DOUBLE UNSIGNED with a negative number
35	functional sqlancer tidb 35522	CS	803	803	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	incorrect unresolved column when using natural join
36	functional sqlancer tidb 35522	SS	409	409	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	incorrect unresolved column when using natural join
37	functional sqlancer tidb challenge 19	CS	811	811	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result for LEFT JOIN and CASE operator
38	functional sqlancer tidb challenge 19	SS	464	464	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	Incorrect result for LEFT JOIN and CASE operator
39	functional sqlancer tidb challenge 48	CS	794	794	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
40	functional sqlancer tidb challenge 48	SS	438	438	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	UNIQUE constraint on DECIMAL/floating-point columns causes incorrect result for NULL in AND
41	functional tabloid ibp 124	CS	766	766	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1
42	functional tabloid ibp 124	SS	451	451	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	WHERE CURRENT OF <C> within block that has savepoint: statement #2 must see changes produced by statement #1

List of tests in this report:

https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/arch_2312_17510_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_02_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_04_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_06_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_09_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_10_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_11_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_15_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_17_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_01_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_05_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/osdi20_rigger_example_12_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_15844_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_16028_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_35522_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_19_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/tidb_challenge_48_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_ibp_124.py

=== end of list ===

Last commits information (all timestamps in UTC):