01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (18 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (761 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (13 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (5 rows)
07. Has fails: tests with at least one fail for previous 30 runs (109 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1114 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (3 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (3728 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 24.04.2025 07:15
Tested: HQ50.   Build / date: 5.0.3.1649-5b2d0dcc / 2025.04.21;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
Test TITLE
1 CS 2025.01.18 11:26
17838 17801 17991 17854 17854 18002 18002 17947 17947 17928 17928 17947 17982 18263 18263 17996 18043 17996 17996 17996 17665 2138 2031 2031 2036 2043
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
17737 17737 17759 17759 17818 17818 17818 17697 17591 17308 17308 17308 17407 17407 17658 17658 17658 17418 17635 17418 17289 1830 1761 1761 1752 1753
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46
797 750 440 440 750 440 439 439 439 439 439 457 758 800 800 800 392 392 392 426 838 838 796 796 796 796
Offset value for SUBSTRING from BLOB more than 32767 makes exception
4 SS 2023.12.11 11:27
752 752 421 396 396 407 407 406 407 407 406 395 395 386 377 376 327 325 325 327 372 377 380 395 395 395
Parameters inside the CAST function are described as not nullable
5 SS 2022.02.02 14:46
751 751 440 431 418 431 440 431 394 500 613 400 656 656 400 388 354 346 346 354 420 420 420 413 413 396
Preparation of erroneous DDL statement does not show the main command failed

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
Test TITLE
1 CS 2025.01.18 11:26 17838 17801 17991 18066 17731 17694 18002 17854 19810 19008 17928 17947 17828 17928 18399 17982 18637 18263 17778 17996 18043 17665 18146 1971 2031 2138 2001 2106 2036 2043
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 17269 17025 17898 17737 17759 17362 19514 17897 17818 17591 17697 17308 17206 17165 17407 17723 17658 17305 17717 17418 17723 17289 17635 1830 1752 1730 1761 2093 1737 1753
Count (DISTINCT ...) is too slow
3 SS 2022.02.02 14:46 829 814 410 416 797 750 440 403 846 420 439 457 422 758 417 800 818 814 380 384 392 838 426 847 860 796 437 786 798 799
Offset value for SUBSTRING from BLOB more than 32767 makes exception
4 SS 2023.12.11 11:27 766 780 752 375 371 765 421 396 376 407 412 406 750 386 395 376 707 377 325 327 312 317 380 377 372 395 699 493 390 378
Parameters inside the CAST function are described as not nullable
5 SS 2022.02.02 14:46 396 751 801 1238 397 418 440 431 387 500 613 388 394 656 701 400 675 388 330 354 346 331 691 420 440 413 389 392 694 396
Preparation of erroneous DDL statement does not show the main command failed

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2211
http://tracker.firebirdsql.org/browse/CORE-3475
http://tracker.firebirdsql.org/browse/CORE-4376
=== end of list ===

Last commits information (all timestamps in UTC):