01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (19 rows)
[CURRENT] 08. Has runtime errors: tests with at least one runtime error for previous 30 runs (6 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2486 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 28.06.2025 08:13
Tested: FB40.   Build / date: 4.0.6.3215-6461d039 / 2025.06.25;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "ERROR" for last 30 runs:

NN Test name mode
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
Test TITLE
1 CS X X X X X X X X X X X X X X X X X X X X X X X X E X X X X X
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
2 SS X X X X X X X X X X X X X X X X X X X X X X X X E X X X X X
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
3 CS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
4 SS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
5 CS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list
6 SS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
Test TITLE
1 CS 760 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 760 0 0 0 0 0
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
2 SS 407 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 407 0 0 0 0 0
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
3 CS 1817 1492 1656 1494 1379 1142 1818 1816 1855 1878 1852 1838 1821 1603 1768 1827 1890 1843 1942 1869 1653 1953 1716 1179 1827 1770 1955 1676 1822 1779 1801
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
4 SS 1379 1111 1089 1191 1123 638 1505 1316 1648 1294 1362 1581 1526 1435 1260 1172 1437 1544 1566 1379 1366 1520 1561 1912 1244 1512 1547 1361 1380 1432 1170
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
5 CS 1211 1379 1514 1453 1577 808 1868 1716 2010 1895 1831 1887 1833 1636 1685 1432 1947 1015 978 955 934 986 909 802 1014 978 972 959 956 1044 1036
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list
6 SS 1105 1208 1306 1178 1203 712 1425 1218 1655 1457 1429 1472 1342 1291 1379 1158 1475 774 827 713 777 800 787 1053 709 697 818 684 716 725 785
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_sql_join_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_sql_join_04.py
https://github.com/FirebirdSQL/firebird/issues/8109
=== end of list ===

Last commits information (all timestamps in UTC):