01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (34 rows)
07. Has fails: tests with at least one fail for previous 30 runs (12 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2441 rows)
12. Skipped: tests which was intentionally excluded from execution (63 rows)

Generated UTC 03.12.2024 06:16
Tested: FB40.   Build / date: 4.0.6.3170-68abd6b4 / 2024.12.02;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
4.0.6.3168
2024.11.27
4.0.6.3168
2024.11.07
4.0.6.3167
2024.11.04
4.0.6.3165
2024.10.23
4.0.6.3164
2024.10.17
4.0.6.3161
2024.10.05
4.0.6.3159
2024.10.01
4.0.6.3158
2024.09.30
4.0.6.3157
2024.09.24
4.0.6.3156
2024.09.21
4.0.6.3155
2024.09.20
4.0.6.3151
2024.09.09
4.0.6.3149
2024.09.04
4.0.6.3148
2024.09.02
4.0.6.3147
2024.08.30
4.0.6.3146
2024.08.27
4.0.6.3145
2024.08.21
4.0.6.3144
2024.08.20
4.0.6.3142
2024.08.11
4.0.6.3141
2024.08.09
4.0.5.3140
2024.08.06
4.0.5.3139
2024.08.01
4.0.5.3136
2024.07.31
4.0.5.3135
2024.07.26
Test TITLE
1 CS 2022.02.02 14:46
48133 34542 31818 31818 31818 31999 48102 49868 72004 49868 67901 72004 72604 72604 72769 72769 72604 31607 30819 30819 30595 30819 30619 30847 30619 30847
Wrong results or unexpected errors while sorting a large data set

Elapsed time, milliseconds:

NN Test name mode
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
4.0.6.3168
2024.11.27
4.0.6.3168
2024.11.07
4.0.6.3167
2024.11.04
4.0.6.3165
2024.10.23
4.0.6.3164
2024.10.17
4.0.6.3161
2024.10.05
4.0.6.3159
2024.10.01
4.0.6.3158
2024.09.30
4.0.6.3157
2024.09.24
4.0.6.3156
2024.09.21
4.0.6.3155
2024.09.20
4.0.6.3151
2024.09.09
4.0.6.3149
2024.09.04
4.0.6.3148
2024.09.02
4.0.6.3147
2024.08.30
4.0.6.3146
2024.08.27
4.0.6.3145
2024.08.21
4.0.6.3144
2024.08.20
4.0.6.3142
2024.08.11
4.0.6.3141
2024.08.09
4.0.5.3140
2024.08.06
4.0.5.3139
2024.08.01
4.0.5.3136
2024.07.31
4.0.5.3135
2024.07.26
4.0.5.3129
2024.07.24
4.0.5.3128
2024.07.13
4.0.5.3127
2024.07.10
4.0.5.3123
2024.07.09
Test TITLE
1 CS 55136 51875 34542 48133 30243 30539 31818 31999 91884 48102 49868 72004 94760 30354 67901 76475 72604 75561 72769 31607 30104 30819 30595 78590 30007 32188 30619 30847 29000 31647
Wrong results or unexpected errors while sorting a large data set

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
=== end of list ===

Last commits information (all timestamps in UTC):