01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (2 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (5 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (14 rows)
07. Has fails: tests with at least one fail for previous 35 runs (142 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (746 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (2 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (4 rows)
11. All tests: outcomes for previous 35 runs (3319 rows)
12. Skipped: tests which was intentionally excluded from execution (253 rows)

Generated UTC 29.07.2025 12:48
Tested: HQ40.   Build / date: 4.0.6.3222-685b73e2 / 2025.07.22;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3222
2025.07.22
4.0.6.3221
2025.07.15
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
Test TITLE
1 CS 2025.01.18 11:26
21875 21875 21838 21870 21870 21870 21768 21768 2586 2271 2271 2271 2257 2311 2311 X 2105 1969 1938 1922 1922 1891 1874 1874 1874 1874 1874 1875 1875 1890 2030
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
21389 21388 21281 21259 21207 21207 21207 21075 2355 1976 1976 2038 2070 2070 2070 2070 1874 1781 1704 1688 1688 1671 1656 1656 1656 1656 1671 1671 1671 1687 1702
Count (DISTINCT ...) is too slow
3 SS 2025.06.26 15:41
1079 1079 1097 1098 1098 1098 1098 1097 1078 1097 1111 1111 1111 1111 1070 1022 760 422 422 422 421 391 390 390 390 390 390 390 405 406 531
Nbackup as online dump
4 CS 2022.02.02 14:46
2445 2445 2445 1572 1570 1566 1566 1566 1577 1587 1595 1655 1655 1655 1652 1500 1500 1475 1469 1484 1469 1469 1358 1358 1358 1358 1358 1343 1358 1358 1546
Incomplete API information values
5 CS 2025.07.24 19:14
6095 5991 5991 2182 2175 2175 1894 1894 2083 2173 2112 2112 2173 2112 1998 1669 1667 1578 1563 1563 1563 1563 1514 1514 1499 1499 1514 1514 1514 1515 1655
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
6 SS 2025.07.24 19:14
5758 5523 5523 1586 1407 1407 1407 1411 1411 1411 1431 1436 1437 1436 1436 1326 1316 1172 1172 1172 1157 1156 1140 1140 1140 1139 1140 1139 1140 1140 1187
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
7 SS 2025.01.18 14:04
1835 1835 1844 1856 1856 1851 1861 1851 1843 1843 1843 1843 1892 1892 1892 1775 1757 1626 1625 1625 1625 594 593 593 593 593 593 593 593 593 655
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
8 CS 2024.08.22 13:09
5124 5118 5118 5144 5156 5156 5156 5136 5136 5136 5358 5358 5358 2860 2852 2655 2569 2485 2406 2406 2391 2375 2328 2328 2327 2327 2327 2312 2312 2390 2468
Improve performance of CURRENT_TIME
9 SS 2024.08.22 13:09
4839 4839 4885 4887 4887 4896 4896 4928 4993 4963 4993 4993 4963 2592 2577 2500 2346 2157 2141 2141 2141 2140 2140 2140 2126 2126 2077 2077 2077 2077 2108
Improve performance of CURRENT_TIME
10 SS 2023.03.01 18:52
417 418 421 421 432 433 433 433 433 415 415 433 468 468 526 468 360 235 234 234 234 234 234 233 233 234 234 234 234 234 280
Firebird does not find an record when adding a foreign key
11 CS 2024.07.12 10:11
2256 2230 2223 1430 1430 1430 1439 1442 1449 1449 1449 1506 X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
12 SS 2024.07.12 10:11
2012 2006 1981 1216 1216 1204 1209 1216 1223 1221 1223 1241 X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
13 SS 2025.07.08 18:26
1211 1190 X X 1190 1169 1169 1169 1138 1138 1138 1495 X 1495 X 1495 1488 1188 1187 1172 1172 1140 1140 1140 1140 1140 1140 1140 1139 750 749
Verify ability to create database with different values of PAGE_SIZE
14 SS 2024.07.14 08:47
240 241 X X 243 245 243 243 243 243 243 243 X 240 X 157 156 156 156 156 141 140 139 139 139 139 140 140 139 139 139
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3222
2025.07.22
4.0.6.3221
2025.07.15
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.05
Test TITLE
1 CS 2025.01.18 11:26 22418 21875 21838 21784 22574 22076 21746 21870 21768 22039 2586 2271 2226 2257 2311 X 2465 2105 2361 1891 1969 1922 1938 1891 1874 1874 1874 1875 1874 1858 1890 1875 2050 2030 2030
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 21389 21717 21607 21388 21281 21189 21259 21075 21207 21219 1947 1976 2355 1975 2038 2070 2076 2165 1874 1688 1781 1688 1704 1656 1671 1656 1655 1672 1656 1671 1687 1655 1702 1702 1703
Count (DISTINCT ...) is too slow
3 SS 2025.06.26 15:41 1104 878 1079 1097 1039 1110 1101 1098 1054 1078 1120 1097 1035 1134 1111 1127 1070 1022 760 422 422 421 422 391 389 390 390 390 390 405 406 390 546 531 531
Nbackup as online dump
4 CS 2022.02.02 14:46 2261 2247 2445 2550 2541 1572 1570 1553 1547 1566 1577 1595 1587 1933 1655 1673 1652 1475 1441 1500 1516 1469 1469 1484 1358 1343 1358 1343 1390 1358 1343 1343 1578 1546 1562
Incomplete API information values
5 CS 2025.07.24 19:14 11161 5876 5991 6309 6095 2182 2175 1863 1791 2199 1894 2083 2259 2173 2112 1998 2317 1669 1667 1547 1547 1578 1563 1563 1514 1499 1499 1514 1483 1515 1514 1514 1686 1656 1655
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
6 SS 2025.07.24 19:14 10854 5512 5523 5758 6099 1380 1407 1586 1400 1411 1398 1431 1437 1404 1448 1436 1443 1316 1326 1172 1172 1157 1172 1156 1140 1124 1140 1139 1140 1124 1140 1125 1202 1202 1187
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
7 SS 2025.01.18 14:04 1830 1829 1835 1844 1856 1832 1882 1906 1851 1841 1861 1834 1843 1843 1896 1892 1896 1757 1775 1626 1625 1625 1625 594 593 593 593 592 593 593 593 593 655 656 671
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
8 CS 2024.08.22 13:09 5124 5126 4973 5118 5144 5098 5156 5369 5168 5136 5129 5131 5442 5392 5358 2852 2860 2655 2569 2406 2485 2391 2375 2422 2328 2327 2327 2343 2280 2312 2390 2265 2483 2468 2468
Improve performance of CURRENT_TIME
9 SS 2024.08.22 13:09 4870 4839 4732 4910 4825 4885 4896 4887 5040 4928 4842 4996 4993 4963 5498 2577 2500 2592 2346 2157 2141 2141 2141 2140 2125 2140 2140 2126 2062 2077 2077 2062 2124 2108 2139
Improve performance of CURRENT_TIME
10 SS 2023.03.01 18:52 414 416 524 418 417 432 421 455 450 433 415 415 433 414 605 468 526 360 604 235 234 234 234 234 233 233 234 233 234 234 234 234 280 281 280
Firebird does not find an record when adding a foreign key
11 CS 2024.07.12 10:11 2256 2352 2223 2230 2314 1416 1430 1416 1442 1455 1439 1449 1449 2057 1506 1568 X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
12 SS 2024.07.12 10:11 2039 2006 1981 2012 2103 1200 1202 1216 1311 1204 1209 1223 1241 1221 1247 1244 X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
13 SS 2025.07.08 18:26 1237 1246 X X 1211 1135 1128 1190 1321 1169 1138 1136 X 1120 X 1630 1626 1495 1488 1156 1188 1172 1187 1125 1140 1140 1124 1140 1140 1140 1139 733 750 749 749
Verify ability to create database with different values of PAGE_SIZE
14 SS 2024.07.14 08:47 230 240 X X 239 245 243 241 258 253 242 243 X 240 X 286 283 152 157 156 156 157 141 125 140 139 139 140 139 140 140 139 139 139 139
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-2307
http://tracker.firebirdsql.org/browse/CORE-3549
http://tracker.firebirdsql.org/browse/CORE-3977
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_00.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7108
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):