nix-3x new_perf

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (7 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (10 rows)
11. All tests: outcomes for previous 30 runs (2004 rows)
12. Skipped: tests which was intentionally excluded from execution (65 rows)

Generated UTC 21.11.2024 05:46
Tested: FB30. Build / date: 3.0.13.33794-e2a6b2ef / 2024.10.23;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:

NN	Test name	mode	Test last update	Moving medians chart	3.0.13.33794 2024.10.23 e2a6b	3.0.13.33793 2024.09.02 3e627	3.0.13.33792 2024.08.30 d9f38	3.0.13.33791 2024.08.21 c8a36	3.0.13.33790 2024.08.20 3bf52	3.0.13.33789 2024.08.09 7933a	3.0.12.33787 2024.08.06 bf180	3.0.12.33784 2024.08.01 cd857	3.0.12.33779 2024.07.31 ae35d	3.0.12.33778 2024.07.21 4680d	3.0.12.33777 2024.07.19 8e912	3.0.12.33766 2024.07.13 b5086	3.0.12.33765 2024.07.10 06f2a	3.0.12.33764 2024.06.18 4d0c0	3.0.12.33761 2024.06.17 b259d	3.0.12.33758 2024.06.14 4f9bc	3.0.12.33757 2024.06.13 c7a1c	3.0.12.33744 2024.04.19 ecf36	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 5457 tracker	SS	2022.02.02 14:46		11	7	7	6	6	6	6	8	8	6	8	7	7	7	X	X	X	X	X	X	X	X	X	X	X	X	Bugcheck 167 (invalid SEND request)
2	functional intfunc string right 01	CS	2022.02.04 18:05		11	8	9	9	7	7	7	7	7	8	7	7	7	7	X	X	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN	Test name	mode	3.0.13.33794 2024.10.23 e2a6b	3.0.13.33793 2024.09.02 3e627	3.0.13.33792 2024.08.30 d9f38	3.0.13.33791 2024.08.21 c8a36	3.0.13.33790 2024.08.20 3bf52	3.0.13.33789 2024.08.09 7933a	3.0.12.33787 2024.08.06 bf180	3.0.12.33784 2024.08.01 cd857	3.0.12.33779 2024.07.31 ae35d	3.0.12.33778 2024.07.21 4680d	3.0.12.33777 2024.07.19 8e912	3.0.12.33766 2024.07.13 b5086	3.0.12.33765 2024.07.10 06f2a	3.0.12.33764 2024.06.18 4d0c0	3.0.12.33761 2024.06.17 b259d	3.0.12.33758 2024.06.14 4f9bc	3.0.12.33757 2024.06.13 c7a1c	3.0.12.33744 2024.04.19 ecf36	X	X	X	X	X	X	X	X	X	X	X	X	Test TITLE
1	bugs core 5457 tracker	SS	524	5	7	11	16	5	6	5	8	6	9	8	6	6	10	7	15	6	X	X	X	X	X	X	X	X	X	X	X	X	Bugcheck 167 (invalid SEND request)
2	functional intfunc string right 01	CS	4167	6	8	11	11	5	9	7	7	11	6	7	8	8	7	4	5	8	X	X	X	X	X	X	X	X	X	X	X	X	RIGHT( <string>, <number> )

List of tests in this report:

http://tracker.firebirdsql.org/browse/core-5457
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py

=== end of list ===

Tests with performance slowdown for LAST 5 runs - moving medians

Elapsed time, milliseconds:

List of tests in this report:

Last commits information (all timestamps in UTC):