01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (32 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (9 rows)
07. Has fails: tests with at least one fail for previous 30 runs (120 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1105 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
11. All tests: outcomes for previous 30 runs (3710 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 31.03.2025 10:14
Tested: HQ50.   Build / date: 5.0.3.1633-3123a5a0 / 2025.03.28;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
Test TITLE
1 SS 2022.02.02 14:46
750 440 439 439 439 439 439 457 758 800 800 800 392 392 392 426 838 838 796 796 796 796 786 786 719 675
Offset value for SUBSTRING from BLOB more than 32767 makes exception
2 SS 2024.11.17 08:40
878 501 851 851 851 851 851 880 880 910 877 877 407 402 402 407 449 460 460 460 460 408 397 397 478 440
Regression: ORDER BY clause on compound index may disable usage of other indices

Elapsed time, milliseconds:

NN Test name mode
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
Test TITLE
1 SS 797 750 440 403 846 420 439 457 422 758 417 800 818 814 380 384 392 838 426 847 860 796 437 786 798 799 429 675 719 627
Offset value for SUBSTRING from BLOB more than 32767 makes exception
2 SS 899 501 496 878 903 450 851 484 880 922 454 910 877 927 379 407 402 376 449 470 874 460 408 390 536 397 392 491 478 440
Regression: ORDER BY clause on compound index may disable usage of other indices

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-2211
http://tracker.firebirdsql.org/browse/CORE-5020
=== end of list ===

Last commits information (all timestamps in UTC):