01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (44 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2444 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 16.01.2025 13:41
Tested: HQ40.   Build / date: 4.0.6.3169-42cc1914 / 2024.12.13;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X
Test TITLE
1 CS 2022.02.02 14:46
35914 2896 2896 2687 2850 2850 2687 2662 2479 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2 SS 2022.02.02 14:46
34659 2445 2445 2395 2445 2445 2487 2395 2385 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 2023.12.11 15:18
1671 626 626 626 752 752 894 752 752 X X X X X X X X X X X X X X X X X
Original table name and column name and owner missing from SQLDA for aliased column in grouped query
4 SS 2022.02.02 14:46
1438 388 1438 1441 1495 1495 1495 1493 1385 X X X X X X X X X X X X X X X X X
EXECUTE STATEMENT fails on FB 4.x if containing time/timestamp with time zone parameters

Elapsed time, milliseconds:

NN Test name mode
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 45650 35914 36404 2558 2362 2896 5841 2687 2850 2377 2662 2479 2401 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2 SS 46576 35889 34659 2359 2285 2445 3867 2395 2487 2385 2518 2319 2242 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 1787 1671 1694 613 580 626 1087 894 752 718 1768 626 1609 X X X X X X X X X X X X X X X X X
Original table name and column name and owner missing from SQLDA for aliased column in grouped query
4 SS 1534 358 1438 388 1441 340 2325 1541 1495 1385 1493 1360 270 X X X X X X X X X X X X X X X X X
EXECUTE STATEMENT fails on FB 4.x if containing time/timestamp with time zone parameters

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-3973
http://tracker.firebirdsql.org/browse/CORE-6453
=== end of list ===

Last commits information (all timestamps in UTC):