nix-3x new_perf

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (44 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2044 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated UTC 17.01.2025 15:40
Tested: HQ30. Build / date: 3.0.13.33796-99b3bbff / 2025.01.14;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:

NN	Test name	mode	Test last update	3.0.13.33796 2025.01.14 99b3b	3.0.13.33795 2024.11.24 b8847	3.0.13.33794 2024.10.15 abe09	3.0.13.33793 2024.10.04 82ccc	3.0.13.33792 2024.08.31 d8791	3.0.13.33787 2024.08.17 2e0d6	3.0.13.33787 2024.08.09 df740	3.0.12.33746 2024.07.15 11dd4	3.0.12.33746 2024.06.11 8a5eb	3.0.12.33744 2024.05.09 9cf37	3.0.12.33744 2024.04.20 af6b2	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 1363 tracker	CS	2022.02.02 14:46	825	10	8	8	8	10	8	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ISQL crash when converted-from-double string longer than 23 bytes
2	bugs core 3479 tracker	CS	2022.02.02 14:46	936	9	9	9	9	7	6	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ASCII_VAL raises error instead of return 0 for empty strings
3	bugs core 5457 tracker	CS	2022.02.02 14:46	1013	9	9	9	9	9	7	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Bugcheck 167 (invalid SEND request)
4	functional intfunc string right 01	SS	2022.02.04 18:05	3934	10	8	8	8	8	7	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN	Test name	mode	3.0.13.33796 2025.01.14 99b3b	3.0.13.33795 2024.11.24 b8847	3.0.13.33794 2024.10.15 abe09	3.0.13.33793 2024.10.04 82ccc	3.0.13.33792 2024.08.31 d8791	3.0.13.33787 2024.08.17 2e0d6	3.0.13.33787 2024.08.09 df740	3.0.12.33746 2024.07.15 11dd4	3.0.12.33746 2024.06.11 8a5eb	3.0.12.33744 2024.05.09 9cf37	3.0.12.33744 2024.04.20 af6b2	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 1363 tracker	CS	1076	1124	825	4	5	10	8	22	5	16	5	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ISQL crash when converted-from-double string longer than 23 bytes
2	bugs core 3479 tracker	CS	1287	1296	936	6	9	9	7	29	6	6	6	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	ASCII_VAL raises error instead of return 0 for empty strings
3	bugs core 5457 tracker	CS	1355	1404	1013	6	6	9	9	19	7	5	5	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	Bugcheck 167 (invalid SEND request)
4	functional intfunc string right 01	SS	4637	4362	3934	4	7	10	8	16	7	5	6	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

List of tests in this report:

http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-5457
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py

=== end of list ===

Tests with performance slowdown for LAST 5 runs - moving medians

Elapsed time, milliseconds:

List of tests in this report:

Last commits information (all timestamps in UTC):