nix-3x new_perf

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (7 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2004 rows)
12. Skipped: tests which was intentionally excluded from execution (65 rows)

Generated UTC 17.01.2025 08:06
Tested: FB30. Build / date: 3.0.13.33798-0c3bbd83 / 2025.01.16;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:

NN	Test name	mode	Test last update	3.0.13.33798 2025.01.16 0c3bb	3.0.13.33795 2024.12.23 1bf0b	3.0.13.33794 2024.10.23 e2a6b	3.0.13.33793 2024.09.02 3e627	3.0.13.33792 2024.08.30 d9f38	3.0.13.33791 2024.08.21 c8a36	3.0.13.33790 2024.08.20 3bf52	3.0.13.33789 2024.08.09 7933a	3.0.12.33787 2024.08.06 bf180	3.0.12.33784 2024.08.01 cd857	3.0.12.33779 2024.07.31 ae35d	3.0.12.33778 2024.07.21 4680d	3.0.12.33777 2024.07.19 8e912	3.0.12.33766 2024.07.13 b5086	3.0.12.33765 2024.07.10 06f2a	3.0.12.33764 2024.06.18 4d0c0	3.0.12.33761 2024.06.17 b259d	3.0.12.33758 2024.06.14 4f9bc	3.0.12.33757 2024.06.13 c7a1c	3.0.12.33744 2024.04.19 ecf36	X	X	X	X	X	X	Test TITLE
1	bugs core 0856 tracker	SS	2022.02.02 14:46	377	11	11	10	10	9	7	7	8	8	8	8	7	6	6	7	X	X	X	X	X	X	X	X	X	X	Unable to set FName, MName, LName fields in security to blank
2	bugs core 2215 tracker	SS	2022.02.02 14:46	438	14	13	12	12	10	8	7	7	7	7	7	7	8	11	11	X	X	X	X	X	X	X	X	X	X	GROUP BY concatenation with empty string
3	bugs core 3479 tracker	SS	2022.02.02 14:46	484	10	9	9	9	8	8	8	7	8	7	7	7	7	7	7	X	X	X	X	X	X	X	X	X	X	ASCII_VAL raises error instead of return 0 for empty strings
4	functional intfunc string right 01	SS	2022.02.04 18:05	3840	15	12	10	10	8	8	7	7	6	6	6	6	7	8	8	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN	Test name	mode	3.0.13.33798 2025.01.16 0c3bb	3.0.13.33795 2024.12.23 1bf0b	3.0.13.33794 2024.10.23 e2a6b	3.0.13.33793 2024.09.02 3e627	3.0.13.33792 2024.08.30 d9f38	3.0.13.33791 2024.08.21 c8a36	3.0.13.33790 2024.08.20 3bf52	3.0.13.33789 2024.08.09 7933a	3.0.12.33787 2024.08.06 bf180	3.0.12.33784 2024.08.01 cd857	3.0.12.33779 2024.07.31 ae35d	3.0.12.33778 2024.07.21 4680d	3.0.12.33777 2024.07.19 8e912	3.0.12.33766 2024.07.13 b5086	3.0.12.33765 2024.07.10 06f2a	3.0.12.33764 2024.06.18 4d0c0	3.0.12.33761 2024.06.17 b259d	3.0.12.33758 2024.06.14 4f9bc	3.0.12.33757 2024.06.13 c7a1c	3.0.12.33744 2024.04.19 ecf36	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 0856 tracker	SS	430	419	377	5	10	11	12	6	9	7	6	10	8	9	5	6	7	6	11	7	X	X	X	X	X	X	X	X	X	X	Unable to set FName, MName, LName fields in security to blank
2	bugs core 2215 tracker	SS	592	609	438	6	13	14	12	10	7	5	8	7	6	8	7	6	11	12	13	5	X	X	X	X	X	X	X	X	X	X	GROUP BY concatenation with empty string
3	bugs core 3479 tracker	SS	608	594	484	6	10	7	9	9	7	8	8	7	5	8	7	6	7	5	7	7	X	X	X	X	X	X	X	X	X	X	ASCII_VAL raises error instead of return 0 for empty strings
4	functional intfunc string right 01	SS	4028	3996	3840	4	10	15	12	6	8	8	7	6	5	6	7	4	8	8	19	9	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

List of tests in this report:

http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py

=== end of list ===

Tests with performance slowdown for LAST 5 runs - moving medians

Elapsed time, milliseconds:

List of tests in this report:

Last commits information (all timestamps in UTC):