01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (20 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
07. Has fails: tests with at least one fail for previous 30 runs (77 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (7 rows)
11. All tests: outcomes for previous 30 runs (3424 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 28.06.2025 11:35
Tested: HQ50.   Build / date: 5.0.3.1674-3ee5cc1f / 2025.06.27;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1674
2025.06.27
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
Test TITLE
1 SS 2025.06.26 07:18
830 830 534 534 534 534 538 541 556 541 547 546 546 544 544 544 544 577 577 577 577 558 544 544 544 544
Incorrect "key size exceeds implementation restriction for index" error
2 SS 2022.02.02 14:46
814 814 814 829 829 836 839 839 417 419 419 419 419 419 420 750 440 440 750 440 439 439 439 439 439 457
Offset value for SUBSTRING from BLOB more than 32767 makes exception
3 CS 2025.05.17 07:35
1867 1881 1867 1851 1846 1842 1834 815 815 815 815 815 828 838 838 838 840 856 856 856 856 848 837 845 845 818
Minimum grant test
4 SS 2025.05.17 07:35
1076 1076 1071 1071 1058 1055 1045 547 520 X X X X X X 520 X X X X 522 522 520 520 518 X
Minimum grant test

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.3.1674
2025.06.27
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
Test TITLE
1 SS 2025.06.26 07:18 830 841 830 1394 533 534 534 530 570 538 556 541 591 525 547 546 531 544 535 580 584 577 558 536 583 543 544 579 541 550
Incorrect "key size exceeds implementation restriction for index" error
2 SS 2022.02.02 14:46 845 413 406 814 829 836 413 843 417 847 839 408 402 419 420 814 410 416 797 750 440 403 846 420 439 457 422 758 417 800
Offset value for SUBSTRING from BLOB more than 32767 makes exception
3 CS 2025.05.17 07:35 1840 1881 1867 1851 1929 1928 1846 1842 1834 815 794 799 815 828 851 798 838 840 829 857 876 856 837 816 883 848 818 845 805 813
Minimum grant test
4 SS 2025.05.17 07:35 1073 1091 1064 1076 1077 1055 1071 1058 1045 X X X X X X 502 X X X X 510 547 520 522 542 514 X 520 518 501
Minimum grant test

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1715
http://tracker.firebirdsql.org/browse/CORE-2211
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_minimum_grant_test.py
=== end of list ===

Last commits information (all timestamps in UTC):