01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (6 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (8 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (54 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
11. All tests: outcomes for previous 30 runs (2091 rows)
12. Skipped: tests which was intentionally excluded from execution (157 rows)

Generated UTC 17.07.2025 14:39
Tested: HQ30.   Build / date: 3.0.13.33818-a1be6724 / 2025.07.15;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33818
2025.07.15
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X
Test TITLE
1 SS 2023.05.13 17:29
165352 X 1095 1058 1058 1003 940 X X X X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
2 CS 2025.07.10 11:52
X 992 9 8 7 6 6 6 6 5 6 5 X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
3 SS 2025.07.10 11:52
X 479 8 6 6 6 6 6 6 7 7 5 X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
4 SS 2025.07.10 11:53
X 529 9 8 7 7 8 7 8 8 8 7 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
5 CS 2025.07.10 11:53
X 2370 1094 1076 1035 1049 1049 1049 1168 1168 1168 810 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_ROLE
6 SS 2025.07.10 11:53
X 1103 576 564 557 497 497 497 635 635 635 416 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_ROLE
7 CS 2025.07.10 11:53
X 863 9 7 7 6 6 6 6 6 6 6 X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
8 SS 2025.07.10 11:53
X 485 7 6 6 6 6 6 11 11 12 11 X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK

Elapsed time, milliseconds:

NN Test name mode
3.0.13.33818
2025.07.15
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X
Test TITLE
1 SS 165352 X 209281 214526 1095 1058 1003 X X 940 1796 929 X 801 X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
2 CS X 992 1117 1152 9 7 8 5 6 5 8 6 5 5 15 5 X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
3 SS X 479 581 537 5 8 6 5 6 6 11 5 7 8 5 5 X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
4 SS X 529 579 570 8 7 9 5 7 8 14 5 17 7 8 5 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
5 CS X 2370 2992 2880 1035 1076 1094 817 1013 1049 2669 1185 1168 810 726 732 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_ROLE
6 SS X 1103 1226 1284 564 576 557 437 486 497 1414 679 635 416 346 319 X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT CURRENT_ROLE
7 CS X 863 1078 1143 7 9 7 6 5 5 10 6 6 6 7 6 X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
8 SS X 485 560 593 6 6 7 5 5 6 12 11 16 5 21 7 X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-4880
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_34.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_36.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_38.py
=== end of list ===

Last commits information (all timestamps in UTC):