01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (12 rows)
07. Has fails: tests with at least one fail for previous 30 runs (125 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (703 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (3207 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 18.02.2025 02:11
Tested: HQ40.   Build / date: 4.0.6.3183-e4762b7c / 2025.02.17;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3183
2025.02.17
e4762
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.12.07
98d69
4.0.6.3168
2024.12.05
cee43
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.30
832db
4.0.6.3163
2024.10.16
2bb10
4.0.6.3147
2024.09.10
a4d11
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.08.06
f851c
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.20
9eb9b
4.0.5.3083
2024.04.06
300f9
4.0.5.3052
2024.03.16
0f422
4.0.5.3052
2024.03.16
ce273
4.0.5.3052
2024.02.12
cd058
4.0.5.3052
2024.02.07
be290
4.0.5.3052
2024.02.07
6409b
4.0.5.3052
2024.02.02
bbc3f
4.0.5.3052
2024.01.26
48b7c
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26
21870 21870 21768 21768 2586 2271 2271 2271 2257 2311 2311 X 2105 1969 1938 1922 1922 1891 1874 1874 1874 1874 1874 1875 1875 1890
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26
21207 21207 21207 21075 2355 1976 1976 2038 2070 2070 2070 2070 1874 1781 1704 1688 1688 1671 1656 1656 1656 1656 1671 1671 1671 1687
Count (DISTINCT ...) is too slow
3
bugs core 1760 
 tracker
 SS 2022.02.02 14:46
857 857 857 857 857 838 447 447 447 447 447 343 326 266 266 250 250 234 233 233 233 233 233 233 234 234
Support hex numeric and string literals
4
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
1098 1098 1098 1097 1078 1097 1111 1111 1111 1111 1070 1022 760 422 422 422 421 391 390 390 390 390 390 390 405 406
Nbackup as online dump
5
bugs core 2966 
 tracker
 CS 2025.02.07 09:03
73801 73801 55096 55096 50225 50225 50225 69035 69035 72924 72924 31301 30955 27238 26612 26612 26612 26612 26737 26737 26737 26721 26673 26673 26673 26689
Wrong results or unexpected errors while sorting a large data set
6
bugs core 2966 
 tracker
 SS 2025.02.07 09:03
58155 58155 47577 47577 44236 44236 44236 55556 55556 55722 55556 25173 25118 22924 22174 22174 22173 22159 22173 22206 22173 22157 22236 22111 22111 22189
Wrong results or unexpected errors while sorting a large data set
7
bugs core 3977 
 tracker
 SS 2025.01.18 14:04
1851 1851 1861 1851 1843 1843 1843 1843 1892 1892 1892 1775 1757 1626 1625 1625 1625 594 593 593 593 593 593 593 593 593
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
8
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09
5156 5156 5156 5136 5136 5136 5358 5358 5358 2860 2852 2655 2569 2485 2406 2406 2391 2375 2328 2328 2327 2327 2327 2312 2312 2390
Improve performance of CURRENT_TIME
9
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09
4896 4896 4896 4928 4993 4963 4993 4993 4963 2592 2577 2500 2346 2157 2141 2141 2141 2140 2140 2140 2126 2126 2077 2077 2077 2077
Improve performance of CURRENT_TIME
10
bugs gh 7108 
 tracker
 SS 2023.03.01 18:52
450 433 433 433 433 415 415 433 468 468 526 468 360 235 234 234 234 234 234 233 233 234 234 234 234 234
Firebird does not find an record when adding a foreign key
11
functional database create 00 
 SS 2023.12.14 18:53
1160 1169 1169 1169 1138 1138 1138 1495 X 1495 X 1495 1488 1188 1187 1172 1172 1140 1140 1140 1140 1140 1140 1140 1139 750
Verify ability to create database with different values of PAGE_SIZE
12
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47
243 245 243 243 243 243 243 243 X 240 X 157 156 156 156 156 141 140 139 139 139 139 140 140 139 139
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3183
2025.02.17
e4762
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.12.07
98d69
4.0.6.3168
2024.12.05
cee43
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.30
832db
4.0.6.3163
2024.10.16
2bb10
4.0.6.3147
2024.09.10
a4d11
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.08.06
f851c
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.20
9eb9b
4.0.5.3083
2024.04.06
300f9
4.0.5.3052
2024.03.16
0f422
4.0.5.3052
2024.03.16
ce273
4.0.5.3052
2024.02.12
cd058
4.0.5.3052
2024.02.07
be290
4.0.5.3052
2024.02.07
6409b
4.0.5.3052
2024.02.02
bbc3f
4.0.5.3052
2024.01.26
48b7c
4.0.5.3052
2024.01.26
9a7b3
4.0.5.3049
2024.01.25
f6b9d
4.0.5.3049
2024.01.08
b67ce
4.0.5.3049
2024.01.08
97577
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26 22008 22076 21746 21870 21768 22039 2586 2271 2226 2257 2311 X 2465 2105 2361 1891 1969 1922 1938 1891 1874 1874 1874 1875 1874 1858 1890 1875 2050 2030
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26 21291 21189 21259 21075 21207 21219 1947 1976 2355 1975 2038 2070 2076 2165 1874 1688 1781 1688 1704 1656 1671 1656 1655 1672 1656 1671 1687 1655 1702 1702
Count (DISTINCT ...) is too slow
3
bugs core 1760 
 tracker
 SS 2022.02.02 14:46 896 862 825 407 857 868 896 838 423 405 447 454 881 343 326 250 266 250 266 234 233 233 233 233 233 234 233 234 282 281
Support hex numeric and string literals
4
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 1095 1110 1101 1098 1054 1078 1120 1097 1035 1134 1111 1127 1070 1022 760 422 422 421 422 391 389 390 390 390 390 405 406 390 546 531
Nbackup as online dump
5
bugs core 2966 
 tracker
 CS 2025.02.07 09:03 29853 73801 32249 114879 76473 55096 36530 50225 32739 69035 75215 72924 31301 75830 30955 26612 27238 26472 26222 26612 26814 26737 26784 26721 26377 26440 26673 26689 26799 26861
Wrong results or unexpected errors while sorting a large data set
6
bugs core 2966 
 tracker
 SS 2025.02.07 09:03 24642 58155 26889 84570 60167 47577 32937 44236 26153 55722 55556 56390 25173 57100 25118 22174 22924 22159 22033 22206 22173 22157 22236 22282 21720 21861 22283 22111 22189 22205
Wrong results or unexpected errors while sorting a large data set
7
bugs core 3977 
 tracker
 SS 2025.01.18 14:04 1841 1832 1882 1906 1851 1841 1861 1834 1843 1843 1896 1892 1896 1757 1775 1626 1625 1625 1625 594 593 593 593 592 593 593 593 593 655 656
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
8
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09 5058 5098 5156 5369 5168 5136 5129 5131 5442 5392 5358 2852 2860 2655 2569 2406 2485 2391 2375 2422 2328 2327 2327 2343 2280 2312 2390 2265 2483 2468
Improve performance of CURRENT_TIME
9
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09 5370 4885 4896 4887 5040 4928 4842 4996 4993 4963 5498 2577 2500 2592 2346 2157 2141 2141 2141 2140 2125 2140 2140 2126 2062 2077 2077 2062 2124 2108
Improve performance of CURRENT_TIME
10
bugs gh 7108 
 tracker
 SS 2023.03.01 18:52 475 432 421 455 450 433 415 415 433 414 605 468 526 360 604 235 234 234 234 234 233 233 234 233 234 234 234 234 280 281
Firebird does not find an record when adding a foreign key
11
functional database create 00 
 SS 2023.12.14 18:53 1160 1135 1128 1190 1321 1169 1138 1136 X 1120 X 1630 1626 1495 1488 1156 1188 1172 1187 1125 1140 1140 1124 1140 1140 1140 1139 733 750 749
Verify ability to create database with different values of PAGE_SIZE
12
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47 237 245 243 241 258 253 242 243 X 240 X 286 283 152 157 156 156 157 141 125 140 139 139 140 139 140 140 139 139 139
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1760
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-2966
http://tracker.firebirdsql.org/browse/CORE-3977
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_00.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7108
=== end of list ===

Last commits information (all timestamps in UTC):