01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (6 rows)
07. Has fails: tests with at least one fail for previous 30 runs (12 rows)
[CURRENT] 08. Has runtime errors: tests with at least one runtime error for previous 30 runs (6 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2501 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 28.06.2025 08:12
Tested: FB40.   Build / date: 4.0.6.3215-6461d039 / 2025.06.25;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "ERROR" for last 30 runs:

NN Test name mode
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.04.12
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.27
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
Test TITLE
1 CS X X X X X X X X X X X X X X X X X X X X X X X X X X E X X X
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
2 SS X X X X X X X X X X X X X X X X X X X X X X X X X X E X X X
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
3 CS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
4 SS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
5 CS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list
6 SS P P P P E P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.04.12
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.27
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
Test TITLE
1 CS 1539 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1539 0 0 0
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
2 SS 1278 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1278 0 0 0
Plan/Performance regression when using special construct for IN in FB5.x compared to FB3.x
3 CS 1172 1184 1135 1248 1194 868 1237 1140 1234 1133 1130 1186 1133 1136 1110 1190 1178 1244 1246 1133 1242 1225 1184 1149 1214 1141 1159 1166 1134 1198 1149
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
4 SS 805 791 818 813 815 726 820 797 766 803 795 832 788 788 766 801 849 847 881 845 795 839 809 823 808 799 806 798 818 797 805
Ability to run query: ( A LEFT JOIN B ) INER JOIN C, plus ORDER BY with fields not from SELECT list
5 CS 1155 1204 1141 1258 1150 548 1211 1179 1125 1131 1182 1217 1134 1143 1109 1160 1185 1242 1206 1141 1183 1179 1140 1170 1151 1139 1137 1203 1136 1179 1149
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list
6 SS 804 801 817 829 790 424 821 779 781 796 806 817 792 803 781 787 827 840 960 846 805 838 803 812 815 786 833 791 834 801 802
Ability to run query: ( A LEFT JOIN B ) , C. Then add ORDER BY with fields not from SELECT list

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_sql_join_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_sql_join_04.py
https://github.com/FirebirdSQL/firebird/issues/8109
=== end of list ===

Last commits information (all timestamps in UTC):