01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
07. Has fails: tests with at least one fail for previous 30 runs (86 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2621 rows)
12. Skipped: tests which was intentionally excluded from execution (72 rows)

Generated UTC 18.01.2025 04:22
Tested: FB50.   Build / date: 5.0.2.1595-85d825aa / 2025.01.17;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
5.0.2.1577
2024.12.11
5.0.2.1576
2024.12.10
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.02
5.0.2.1570
2024.11.28
5.0.2.1569
2024.11.27
5.0.2.1569
2024.11.25
5.0.2.1567
2024.11.16
5.0.2.1566
2024.11.15
5.0.2.1565
2024.11.14
5.0.2.1564
2024.11.12
5.0.2.1561
2024.11.08
5.0.2.1560
2024.11.08
5.0.2.1560
2024.11.07
5.0.2.1555
2024.11.06
Test TITLE
1 CS 2024.12.03 09:08
17614 18043 18212 18212 18043 17959 17912 17744 17744 17744 17862 17900 17900 17862 2231 2147 2048 2048 2048 2015 2048 2004 2020 2000 2020 X
Count (DISTINCT ...) is too slow
2 SS 2024.12.03 09:08
17063 17343 17459 17459 17459 17204 17204 17204 17218 17218 17218 17218 17196 17100 2107 1766 1754 1754 1754 1754 1754 1761 1761 1761 1761 1778
Count (DISTINCT ...) is too slow
3 SS 2024.11.19 07:13
544 544 544 541 541 541 542 567 567 567 565 556 555 555 547 547 555 689 699 699 689 688 406 406 406 407
Regression: could not execute query (select from view with nested view)
4 CS 2025.01.13 11:44
1290 1290 1289 871 869 867 866 866 866 861 861 870 865 869 869 866 866 866 866 858 895 864 864 857 864 864
Create database: non sysdba user

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
5.0.2.1577
2024.12.11
5.0.2.1576
2024.12.10
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.02
5.0.2.1570
2024.11.28
5.0.2.1569
2024.11.27
5.0.2.1569
2024.11.25
5.0.2.1567
2024.11.16
5.0.2.1566
2024.11.15
5.0.2.1565
2024.11.14
5.0.2.1564
2024.11.12
5.0.2.1561
2024.11.08
5.0.2.1560
2024.11.08
5.0.2.1560
2024.11.07
5.0.2.1555
2024.11.06
5.0.2.1553
2024.11.04
5.0.2.1551
2024.10.30
5.0.2.1550
2024.10.29
5.0.2.1547
2024.10.24
Test TITLE
1 CS 2024.12.03 09:08 17454 17610 17614 18385 18212 18043 18696 17912 17959 17667 17700 17744 18430 18770 17862 17900 2030 2231 2147 2015 2048 2004 2072 1985 2135 2000 X 2020 1994 2042
Count (DISTINCT ...) is too slow
2 SS 2024.12.03 09:08 16953 17033 17063 17343 17775 17459 17693 17204 17204 17038 18577 17218 17518 17100 17196 17271 2107 1727 1729 1766 1754 1780 1747 1718 1761 1812 1778 1739 1745 1829
Count (DISTINCT ...) is too slow
3 SS 2024.11.19 07:13 531 524 544 553 547 541 541 540 542 579 567 567 530 565 556 546 555 539 547 703 699 689 720 688 406 406 405 407 411 424
Regression: could not execute query (select from view with nested view)
4 CS 2025.01.13 11:44 1282 1303 1289 1319 1290 871 869 858 867 866 861 876 859 860 870 892 865 869 866 844 897 858 938 844 895 864 857 855 908 866
Create database: non sysdba user

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-5381
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_02.py
=== end of list ===

Last commits information (all timestamps in UTC):