01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (2 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (18 rows)
07. Has fails: tests with at least one fail for previous 35 runs (142 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (746 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (2 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (109 rows)
11. All tests: outcomes for previous 35 runs (3480 rows)
12. Skipped: tests which was intentionally excluded from execution (253 rows)

Generated UTC 01.09.2025 08:47
Tested: HQ40.   Build / date: 4.0.6.3223-970bec8a / 2025.08.18;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3223
2025.08.18
4.0.6.3222
2025.07.22
4.0.6.3221
2025.07.15
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
Test TITLE
1 CS 2025.01.18 11:26
21875 X 21875 21838 21870 21870 21870 21768 21768 2586 2271 2271 2271 2257 2311 2311 X 2105 1969 1938 1922 1922 1891 1874 1874 1874 1874 1874 1875 1875 1890
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
21428 21388 21388 21281 21259 21207 21207 21207 21075 2355 1976 1976 2038 2070 2070 2070 2070 1874 1781 1704 1688 1688 1671 1656 1656 1656 1656 1671 1671 1671 1687
Count (DISTINCT ...) is too slow
3 CS 2025.06.25 15:39
1645 1642 855 848 848 848 828 828 848 848 853 881 899 927 927 927 817 763 656 656 656 641 640 608 593 593 593 593 593 593 624
User (not SYSDBA) that have privileges with grant option, can't revoke privileges, granted by other user or SYSDBA
4 SS 2025.06.25 15:39
991 979 531 531 529 530 530 530 530 535 547 547 548 564 564 564 455 451 344 344 343 343 312 312 312 311 311 312 312 312 335
User (not SYSDBA) that have privileges with grant option, can't revoke privileges, granted by other user or SYSDBA
5 SS 2025.06.26 07:18
890 890 567 567 567 567 567 565 565 565 565 567 614 614 614 614 487 482 391 391 375 375 359 359 359 359 359 359 358 358 374
Incorrect "key size exceeds implementation restriction for index" error
6 SS 2025.06.26 15:41
1068 1042 1079 1097 1098 1098 1098 1098 1097 1078 1097 1111 1111 1111 1111 1070 1022 760 422 422 422 421 391 390 390 390 390 390 390 405 406
Nbackup as online dump
7 CS 2025.07.24 19:14
6309 6095 5991 5991 2182 2175 2175 1894 1894 2083 2173 2112 2112 2173 2112 1998 1669 1667 1578 1563 1563 1563 1563 1514 1514 1499 1499 1514 1514 1514 1515
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
8 SS 2025.07.24 19:14
5758 5758 5523 5523 1586 1407 1407 1407 1411 1411 1411 1431 1436 1437 1436 1436 1326 1316 1172 1172 1172 1157 1156 1140 1140 1140 1139 1140 1139 1140 1140
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
9 SS 2025.01.18 14:04
1835 1835 1835 1844 1856 1856 1851 1861 1851 1843 1843 1843 1843 1892 1892 1892 1775 1757 1626 1625 1625 1625 594 593 593 593 593 593 593 593 593
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
10 CS 2024.08.22 13:09
5118 5118 5118 5118 5144 5156 5156 5156 5136 5136 5136 5358 5358 5358 2860 2852 2655 2569 2485 2406 2406 2391 2375 2328 2328 2327 2327 2327 2312 2312 2390
Improve performance of CURRENT_TIME
11 SS 2024.08.22 13:09
4856 4839 4839 4885 4887 4887 4896 4896 4928 4993 4963 4993 4993 4963 2592 2577 2500 2346 2157 2141 2141 2141 2140 2140 2140 2126 2126 2077 2077 2077 2077
Improve performance of CURRENT_TIME
12 SS 2023.03.01 18:52
418 418 418 421 421 432 433 433 433 433 415 415 433 468 468 526 468 360 235 234 234 234 234 234 233 233 234 234 234 234 234
Firebird does not find an record when adding a foreign key
13 CS 2024.07.12 10:11
2237 2237 2230 2223 1430 1430 1430 1439 1442 1449 1449 1449 1506 X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
14 SS 2024.07.12 10:11
2009 2012 2006 1981 1216 1216 1204 1209 1216 1223 1221 1223 1241 X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
15 SS 2025.07.08 18:26
1227 1211 1190 X X 1190 1169 1169 1169 1138 1138 1138 1495 X 1495 X 1495 1488 1188 1187 1172 1172 1140 1140 1140 1140 1140 1140 1140 1139 750
Verify ability to create database with different values of PAGE_SIZE
16 CS 2025.05.17 07:35
1940 1939 881 871 862 862 867 867 852 867 867 870 907 907 907 893 764 764 735 735 735 734 719 609 609 608 609 608 593 608 624
Minimum grant test
17 CS 2025.07.12 08:33
2481 2448 1045 1028 1016 1019 1019 1020 1020 1032 1037 1064 1097 1114 1114 1097 964 938 938 938 938 938 906 765 765 764 764 765 765 765 767
Check ability to query, modify and deleting data plus add/drop constraints on any table
18 SS 2024.07.14 08:47
239 240 241 X X 243 245 243 243 243 243 243 243 X 240 X 157 156 156 156 156 141 140 139 139 139 139 140 140 139 139
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3223
2025.08.18
4.0.6.3222
2025.07.22
4.0.6.3221
2025.07.15
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.17
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
Test TITLE
1 CS 2025.01.18 11:26 22010 X 21875 21838 21784 22574 22076 21746 21870 21768 22039 2586 2271 2226 2257 2311 X 2465 2105 2361 1891 1969 1922 1938 1891 1874 1874 1874 1875 1874 1858 1890 1875 2050 2030
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 21428 21171 21717 21607 21388 21281 21189 21259 21075 21207 21219 1947 1976 2355 1975 2038 2070 2076 2165 1874 1688 1781 1688 1704 1656 1671 1656 1655 1672 1656 1671 1687 1655 1702 1702
Count (DISTINCT ...) is too slow
3 CS 2025.06.25 15:39 1652 1696 1645 1642 801 855 848 819 851 826 828 848 881 853 899 928 971 927 817 763 656 641 656 657 640 592 608 593 592 593 593 593 624 827 811
User (not SYSDBA) that have privileges with grant option, can't revoke privileges, granted by other user or SYSDBA
4 SS 2025.06.25 15:39 991 993 1110 979 515 531 525 537 529 530 550 523 548 535 547 613 564 579 455 451 344 343 343 359 312 312 311 312 311 311 335 312 312 421 421
User (not SYSDBA) that have privileges with grant option, can't revoke privileges, granted by other user or SYSDBA
5 SS 2025.06.26 07:18 876 897 900 890 562 563 567 603 590 558 563 565 618 567 564 614 616 630 487 482 391 375 391 375 359 359 359 359 359 358 358 374 358 421 406
Incorrect "key size exceeds implementation restriction for index" error
6 SS 2025.06.26 15:41 1068 1042 878 1079 1097 1039 1110 1101 1098 1054 1078 1120 1097 1035 1134 1111 1127 1070 1022 760 422 422 421 422 391 389 390 390 390 390 405 406 390 546 531
Nbackup as online dump
7 CS 2025.07.24 19:14 11161 11237 5876 5991 6309 6095 2182 2175 1863 1791 2199 1894 2083 2259 2173 2112 1998 2317 1669 1667 1547 1547 1578 1563 1563 1514 1499 1499 1514 1483 1515 1514 1514 1686 1656
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
8 SS 2025.07.24 19:14 11189 10617 5512 5523 5758 6099 1380 1407 1586 1400 1411 1398 1431 1437 1404 1448 1436 1443 1316 1326 1172 1172 1157 1172 1156 1140 1124 1140 1139 1140 1124 1140 1125 1202 1202
Database corruption after end of session : page xxx is of wrong type expected 4 found 7
9 SS 2025.01.18 14:04 1875 1835 1829 1835 1844 1856 1832 1882 1906 1851 1841 1861 1834 1843 1843 1896 1892 1896 1757 1775 1626 1625 1625 1625 594 593 593 593 592 593 593 593 593 655 656
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
10 CS 2024.08.22 13:09 5191 5096 5126 4973 5118 5144 5098 5156 5369 5168 5136 5129 5131 5442 5392 5358 2852 2860 2655 2569 2406 2485 2391 2375 2422 2328 2327 2327 2343 2280 2312 2390 2265 2483 2468
Improve performance of CURRENT_TIME
11 SS 2024.08.22 13:09 4912 4856 4839 4732 4910 4825 4885 4896 4887 5040 4928 4842 4996 4993 4963 5498 2577 2500 2592 2346 2157 2141 2141 2141 2140 2125 2140 2140 2126 2062 2077 2077 2062 2124 2108
Improve performance of CURRENT_TIME
12 SS 2023.03.01 18:52 418 446 416 524 418 417 432 421 455 450 433 415 415 433 414 605 468 526 360 604 235 234 234 234 234 233 233 234 233 234 234 234 234 280 281
Firebird does not find an record when adding a foreign key
13 CS 2024.07.12 10:11 2277 2237 2352 2223 2230 2314 1416 1430 1416 1442 1455 1439 1449 1449 2057 1506 1568 X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
14 SS 2024.07.12 10:11 2009 2028 2006 1981 2012 2103 1200 1202 1216 1311 1204 1209 1223 1241 1221 1247 1244 X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
15 SS 2025.07.08 18:26 1227 1240 1246 X X 1211 1135 1128 1190 1321 1169 1138 1136 X 1120 X 1630 1626 1495 1488 1156 1188 1172 1187 1125 1140 1140 1124 1140 1140 1140 1139 733 750 749
Verify ability to create database with different values of PAGE_SIZE
16 CS 2025.05.17 07:35 1940 1975 1939 2004 881 862 857 871 852 869 867 832 842 870 911 933 907 893 764 715 735 765 735 734 719 608 609 609 593 593 624 608 593 858 859
Minimum grant test
17 CS 2025.07.12 08:33 2504 2481 2567 2448 1013 1045 1012 1028 1016 1019 1020 1032 1064 1037 1122 1097 1114 1155 930 964 937 938 938 938 906 764 764 765 765 764 764 767 765 1109 1077
Check ability to query, modify and deleting data plus add/drop constraints on any table
18 SS 2024.07.14 08:47 236 231 240 X X 239 245 243 241 258 253 242 243 X 240 X 286 283 152 157 156 156 157 141 125 140 139 139 140 139 140 140 139 139 139
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1083
http://tracker.firebirdsql.org/browse/CORE-1715
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3549
http://tracker.firebirdsql.org/browse/CORE-3977
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_00.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_minimum_grant_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_use_granted_by_clause.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7108
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):