01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (23 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (10 rows)
07. Has fails: tests with at least one fail for previous 30 runs (136 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1090 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (3696 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 22.02.2025 08:33
Tested: HQ50.   Build / date: 5.0.2.1615-4a72664d / 2025.02.20;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
Test TITLE
1 CS 2025.01.18 11:26
17982 18263 18263 17996 18043 17996 17996 17996 17665 2138 2031 2031 2036 2043 2036 2038 2038 2043 2045 2045 2045 2045 1912 1910 1910 X
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
17655 17407 17658 17658 17658 17418 17635 17418 17289 1830 1761 1761 1752 1753 1761 1764 1764 1765 1790 1797 1797 1797 1750 1677 1667 1647
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46
758 800 800 800 392 392 392 426 838 838 796 796 796 796 786 786 719 675 675 675 627 524 349 346 346 345
Offset value for SUBSTRING from BLOB more than 32767 makes exception
4 SS 2024.06.09 15:53
1588 1579 1571 1571 1032 934 934 1032 1571 1624 1624 1619 1619 1593 1593 1593 1597 1617 1617 1597 1516 1516 1516 1516 1483 1483
Recursive EXECUTE STATEMENT works wrong
5 SS 2022.02.02 14:46
656 656 400 388 354 346 346 354 420 420 420 413 413 396 396 444 444 437 437 432 312 312 312 313 317 317
Preparation of erroneous DDL statement does not show the main command failed
6 SS 2024.11.17 08:40
877 910 877 877 407 402 402 407 449 460 460 460 460 408 397 397 478 440 440 440 362 349 342 336 336 333
Regression: ORDER BY clause on compound index may disable usage of other indices
7 CS 2024.08.22 13:09
5066 5066 5066 5007 5007 5007 5047 5099 5099 5099 5099 5078 5078 5115 5102 5115 5115 5102 2883 2756 2621 2496 2479 2472 2469 2444
Improve performance of CURRENT_TIME
8 SS 2024.08.22 13:09
4770 4770 4770 4752 4752 4752 4778 4778 4778 4778 4782 4782 X 4841 4854 4920 4854 4854 2540 2375 2275 2275 2272 2252 2242 2240
Improve performance of CURRENT_TIME
9 CS 2024.07.12 10:11
2177 2177 2176 2176 2176 2130 2130 2164 2164 2158 2158 2128 2082 1286 1281 1281 1281 1323 1323 1323 1189 X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
10 SS 2024.07.12 10:11
1958 1955 1948 1948 1948 1882 1882 1933 1933 1894 1894 1850 X 1188 1119 1085 1085 1085 1085 1085 979 X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.12
5.0.1.1415
2024.06.11
Test TITLE
1 CS 2025.01.18 11:26 17892 17928 18399 17982 18637 18263 17778 17996 18043 17665 18146 1971 2031 2138 2001 2106 2036 2043 1985 2038 2125 2045 2152 1895 1910 2149 1912 1878 1848 X
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 17655 17165 17407 17723 17658 17305 17717 17418 17723 17289 17635 1830 1752 1730 1761 2093 1737 1753 1765 1764 1790 1797 1987 1823 1750 1641 1677 1667 1647 1469
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46 448 758 417 800 818 814 380 384 392 838 426 847 860 796 437 786 798 799 429 675 719 627 890 524 349 346 344 345 349 250
Offset value for SUBSTRING from BLOB more than 32767 makes exception
4 SS 2024.06.09 15:53 2095 1644 1554 1588 1571 1579 891 1032 934 903 1697 1571 1624 1665 1619 1582 1593 1541 1617 1655 1597 1717 1513 1516 1464 1544 1539 1475 1483 1328
Recursive EXECUTE STATEMENT works wrong
5 SS 2022.02.02 14:46 390 656 701 400 675 388 330 354 346 331 691 420 440 413 389 392 694 396 682 444 432 437 309 312 312 317 313 317 671 234
Preparation of erroneous DDL statement does not show the main command failed
6 SS 2024.11.17 08:40 458 922 454 910 877 927 379 407 402 376 449 470 874 460 408 390 536 397 392 491 478 440 342 349 362 336 331 333 781 234
Regression: ORDER BY clause on compound index may disable usage of other indices
7 CS 2024.08.22 13:09 4968 4960 5120 5066 5091 5007 4967 4967 5150 5047 5099 5138 5045 5319 5078 5046 5115 5143 5102 5177 2621 2756 2883 2472 2496 2469 2479 2444 2442 2313
Improve performance of CURRENT_TIME
8 SS 2024.08.22 13:09 4733 4709 4794 4770 4823 4752 4676 4745 5438 4778 4785 4778 X 4763 4782 4920 4841 4854 5252 4999 2375 2540 2275 2272 2242 2281 2225 2252 2240 2032
Improve performance of CURRENT_TIME
9 CS 2024.07.12 10:11 3927 3926 1404 2177 2176 2187 2130 2117 2500 2088 2164 2188 2158 2082 2128 1286 1281 1272 1250 1323 1484 1386 1189 1182 1158 X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
10 SS 2024.07.12 10:11 3852 3920 1156 1955 1958 1948 1878 1874 1966 1882 1933 1950 X 1850 1894 1119 1188 1047 1047 1085 1125 1088 979 976 977 X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2211
http://tracker.firebirdsql.org/browse/CORE-2731
http://tracker.firebirdsql.org/browse/CORE-4376
http://tracker.firebirdsql.org/browse/CORE-5020
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):