01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (32 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (9 rows)
07. Has fails: tests with at least one fail for previous 30 runs (120 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1105 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
11. All tests: outcomes for previous 30 runs (3710 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 31.03.2025 10:14
Tested: HQ50.   Build / date: 5.0.3.1633-3123a5a0 / 2025.03.28;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
Test TITLE
1 CS 2025.01.18 11:26
17854 18002 18002 17947 17947 17928 17928 17947 17982 18263 18263 17996 18043 17996 17996 17996 17665 2138 2031 2031 2036 2043 2036 2038 2038 2043
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26
17818 17818 17818 17697 17591 17308 17308 17308 17407 17407 17658 17658 17658 17418 17635 17418 17289 1830 1761 1761 1752 1753 1761 1764 1764 1765
Count (DISTINCT ...) is too slow
3 SS 2024.06.09 15:53
1575 1582 1592 1592 1592 1644 1592 1588 1571 1579 1571 1571 1032 934 934 1032 1571 1624 1624 1619 1619 1593 1593 1593 1597 1617
Recursive EXECUTE STATEMENT works wrong
4 CS 2023.03.11 07:52
47144 47144 47361 47090 47071 47090 47090 46906 8868 8868 8868 8886 9097 9097 9097 9063 8996 8854 8996 8854 8848 6415 6262 6262 6262 6262
gstat may produce faulty report about presence of some none-encrypted pages in database
5 SS 2023.03.11 07:52
46706 46706 46866 46706 46425 46222 46222 46210 8599 8595 8595 8599 8642 8642 8642 8642 8700 8623 8700 8700 8569 6244 6156 5856 5856 5856
gstat may produce faulty report about presence of some none-encrypted pages in database
6 CS 2023.03.11 07:56
70881 70881 70881 71017 69734 70387 70387 69734 31794 31316 31316 31316 31227 31130 31227 31051 31051 31051 31260 31051 30831 29290 29134 28788 28682 28682
Support backup of encrypted databases
7 SS 2023.03.11 07:56
73850 74115 74115 72510 72232 72510 72068 71726 29423 29423 29423 29905 29905 29905 29297 29065 29065 28786 29297 28786 28693 28179 26742 26541 26177 26177
Support backup of encrypted databases
8 CS 2024.07.12 10:11
4036 4046 4052 4052 4052 4052 3926 3894 2177 2177 2176 2176 2176 2130 2130 2164 2164 2158 2158 2128 2082 1286 1281 1281 1281 1323
Check result of conversion to string in COALESCE that involves all families of data types.
9 SS 2024.07.12 10:11
3901 3901 3901 3901 3906 3912 3912 3906 1958 1955 1948 1948 1948 1882 1882 1933 1933 1894 1894 1850 X 1188 1119 1085 1085 1085
Check result of conversion to string in COALESCE that involves all families of data types.

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
Test TITLE
1 CS 2025.01.18 11:26 17731 17694 18002 17854 19810 19008 17928 17947 17828 17928 18399 17982 18637 18263 17778 17996 18043 17665 18146 1971 2031 2138 2001 2106 2036 2043 1985 2038 2125 2045
Count (DISTINCT ...) is too slow
2 SS 2025.01.18 11:26 17759 17362 19514 17897 17818 17591 17697 17308 17206 17165 17407 17723 17658 17305 17717 17418 17723 17289 17635 1830 1752 1730 1761 2093 1737 1753 1765 1764 1790 1797
Count (DISTINCT ...) is too slow
3 SS 2024.06.09 15:53 1525 1544 1592 1582 1575 2066 2102 1592 1566 1644 1554 1588 1571 1579 891 1032 934 903 1697 1571 1624 1665 1619 1582 1593 1541 1617 1655 1597 1717
Recursive EXECUTE STATEMENT works wrong
4 CS 2023.03.11 07:52 6164 47144 47760 47779 47071 46378 47361 47090 46906 47270 6096 8868 8794 8886 9097 9379 9224 8823 8996 9063 8848 8854 9362 6415 6186 6262 6163 6471 6336 6073
gstat may produce faulty report about presence of some none-encrypted pages in database
5 SS 2023.03.11 07:52 5886 46701 47454 47119 46706 46074 46866 46222 46425 46210 5811 8595 8599 8531 8679 8642 8977 8623 8580 8700 8856 8569 9132 6244 6156 5856 5855 5824 5913 6057
gstat may produce faulty report about presence of some none-encrypted pages in database
6 CS 2023.03.11 07:56 28633 71477 70881 71933 69649 68717 71545 71017 69734 70387 28329 31316 31794 31130 31588 31227 30715 30393 31718 31051 31260 30831 31970 29134 29290 28788 28419 28682 28526 29016
Support backup of encrypted databases
7 SS 2023.03.11 07:56 26364 73850 74115 75641 72232 74581 72510 71726 72068 72921 25996 29008 29423 30512 29905 30403 29065 28375 29297 28786 30479 28693 31335 26742 28179 26152 26177 26541 25927 27298
Support backup of encrypted databases
8 CS 2024.07.12 10:11 1452 4028 4071 4036 4046 4052 4138 4194 3894 3926 1404 2177 2176 2187 2130 2117 2500 2088 2164 2188 2158 2082 2128 1286 1281 1272 1250 1323 1484 1386
Check result of conversion to string in COALESCE that involves all families of data types.
9 SS 2024.07.12 10:11 1162 3908 3952 3901 3875 3883 3912 3906 3941 3920 1156 1955 1958 1948 1878 1874 1966 1882 1933 1950 X 1850 1894 1119 1188 1047 1047 1085 1125 1088
Check result of conversion to string in COALESCE that involves all families of data types.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2731
http://tracker.firebirdsql.org/browse/CORE-5796
http://tracker.firebirdsql.org/browse/CORE-5808
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):