01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (7 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (9 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (9 rows)
07. Has fails: tests with at least one fail for previous 30 runs (107 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (705 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (718 rows)
11. All tests: outcomes for previous 30 runs (3205 rows)
12. Skipped: tests which was intentionally excluded from execution (71 rows)

Generated UTC 31.03.2025 12:15
Tested: HQ40.   Build / date: 4.0.6.3189-1a1a50e4 / 2025.02.25;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
Test TITLE
1 CS 2025.01.18 11:26
21924 21870 21870 21870 21768 21768 2586 2271 2271 2271 2257 2311 2311 X 2105 1969 1938 1922 1922 1891 1874 1874 1874 1874 1874 1875
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
21281 21259 21207 21207 21207 21075 2355 1976 1976 2038 2070 2070 2070 2070 1874 1781 1704 1688 1688 1671 1656 1656 1656 1656 1671 1671
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46
866 862 857 857 857 857 857 838 447 447 447 447 447 343 326 266 266 250 250 234 233 233 233 233 233 233
Support hex numeric and string literals
4 SS 2022.02.02 14:46
1097 1098 1098 1098 1098 1097 1078 1097 1111 1111 1111 1111 1070 1022 760 422 422 422 421 391 390 390 390 390 390 390
Nbackup as online dump
5 SS 2025.01.18 14:04
1851 1856 1856 1851 1861 1851 1843 1843 1843 1843 1892 1892 1892 1775 1757 1626 1625 1625 1625 594 593 593 593 593 593 593
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
6 CS 2024.08.22 13:09
5118 5144 5156 5156 5156 5136 5136 5136 5358 5358 5358 2860 2852 2655 2569 2485 2406 2406 2391 2375 2328 2328 2327 2327 2327 2312
Improve performance of CURRENT_TIME
7 SS 2024.08.22 13:09
4885 4887 4887 4896 4896 4928 4993 4963 4993 4993 4963 2592 2577 2500 2346 2157 2141 2141 2141 2140 2140 2140 2126 2126 2077 2077
Improve performance of CURRENT_TIME
8 SS 2023.03.01 18:52
421 421 432 433 433 433 433 415 415 433 468 468 526 468 360 235 234 234 234 234 234 233 233 234 234 234
Firebird does not find an record when adding a foreign key
9 SS 2024.07.14 08:47
243 X 243 245 243 243 243 243 243 243 X 240 X 157 156 156 156 156 141 140 139 139 139 139 140 140
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
Test TITLE
1 CS 2025.01.18 11:26 21924 21784 22574 22076 21746 21870 21768 22039 2586 2271 2226 2257 2311 X 2465 2105 2361 1891 1969 1922 1938 1891 1874 1874 1874 1875 1874 1858 1890 1875
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 22001 21388 21281 21189 21259 21075 21207 21219 1947 1976 2355 1975 2038 2070 2076 2165 1874 1688 1781 1688 1704 1656 1671 1656 1655 1672 1656 1671 1687 1655
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46 899 866 896 862 825 407 857 868 896 838 423 405 447 454 881 343 326 250 266 250 266 234 233 233 233 233 233 234 233 234
Support hex numeric and string literals
4 SS 2022.02.02 14:46 1086 1097 1039 1110 1101 1098 1054 1078 1120 1097 1035 1134 1111 1127 1070 1022 760 422 422 421 422 391 389 390 390 390 390 405 406 390
Nbackup as online dump
5 SS 2025.01.18 14:04 1851 1844 1856 1832 1882 1906 1851 1841 1861 1834 1843 1843 1896 1892 1896 1757 1775 1626 1625 1625 1625 594 593 593 593 592 593 593 593 593
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
6 CS 2024.08.22 13:09 5047 5118 5144 5098 5156 5369 5168 5136 5129 5131 5442 5392 5358 2852 2860 2655 2569 2406 2485 2391 2375 2422 2328 2327 2327 2343 2280 2312 2390 2265
Improve performance of CURRENT_TIME
7 SS 2024.08.22 13:09 4859 4910 4825 4885 4896 4887 5040 4928 4842 4996 4993 4963 5498 2577 2500 2592 2346 2157 2141 2141 2141 2140 2125 2140 2140 2126 2062 2077 2077 2062
Improve performance of CURRENT_TIME
8 SS 2023.03.01 18:52 422 418 417 432 421 455 450 433 415 415 433 414 605 468 526 360 604 235 234 234 234 234 233 233 234 233 234 234 234 234
Firebird does not find an record when adding a foreign key
9 SS 2024.07.14 08:47 248 X 239 245 243 241 258 253 242 243 X 240 X 286 283 152 157 156 156 157 141 125 140 139 139 140 139 140 140 139
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1760
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3977
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7108
=== end of list ===

Last commits information (all timestamps in UTC):