01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (25 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
07. Has fails: tests with at least one fail for previous 30 runs (79 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (7 rows)
11. All tests: outcomes for previous 30 runs (3425 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 26.06.2025 11:46
Tested: HQ50.   Build / date: 5.0.3.1657-8b4d2d0b / 2025.06.20;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
Test TITLE
1 SS 2022.02.02 14:46
814 829 829 836 839 839 417 419 419 419 419 419 420 750 440 440 750 440 439 439 439 439 439 457 758 800
Offset value for SUBSTRING from BLOB more than 32767 makes exception
2 CS 2025.05.17 07:35
1867 1851 1846 1842 1834 815 815 815 815 815 828 838 838 838 840 856 856 856 856 848 837 845 845 818 813 813
Minimum grant test
3 SS 2025.05.17 07:35
1071 1071 1058 1055 1045 547 520 X X X X X X 520 X X X X 522 522 520 520 518 518 X 520
Minimum grant test
4 CS 2023.12.23 12:28
9084 9084 9084 8955 9094 8955 8774 5714 5714 5714 8774 5602 6466 8882 8632 8632 9358 9358 9358 9358 9386 6615 8862 8465 8858 8465
Disallow replication of RDB$BACKUP_HISTORY

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
Test TITLE
1 SS 2022.02.02 14:46 406 814 829 836 413 843 417 847 839 408 402 419 420 814 410 416 797 750 440 403 846 420 439 457 422 758 417 800 818 814
Offset value for SUBSTRING from BLOB more than 32767 makes exception
2 CS 2025.05.17 07:35 1867 1851 1929 1928 1846 1842 1834 815 794 799 815 828 851 798 838 840 829 857 876 856 837 816 883 848 818 845 805 813 808 825
Minimum grant test
3 SS 2025.05.17 07:35 1064 1076 1077 1055 1071 1058 1045 X X X X X X 502 X X X X 510 547 520 522 542 514 X 520 518 501 520 538
Minimum grant test
4 CS 2023.12.23 12:28 9123 6527 9084 6263 9224 9216 8955 5587 9094 5714 8774 5479 5602 9142 8882 5532 6466 9575 8632 9358 9386 5599 9638 6615 9812 5589 8862 8465 8858 5600
Disallow replication of RDB$BACKUP_HISTORY

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-2211
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_minimum_grant_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_disallow_rdb_backup_history_replication.py
=== end of list ===

Last commits information (all timestamps in UTC):