win-5x new_perf

01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (8 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (5 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (5 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (220 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (727 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (2 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (746 rows)
11. All tests: outcomes for previous 30 runs (3358 rows)
12. Skipped: tests which was intentionally excluded from execution (75 rows)

Generated 17.09.2024 12:14
Tested: HQ50. Build/date: 5.0.2.1489 2024.08.31; latest GH: 994a6ca8;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:

NN	Test name	mode	5.0.2.1489 2024.08.31 994a6	5.0.2.1476 2024.08.09 843ea	5.0.1.1454 2024.08.08 30f9f	5.0.1.1453 2024.08.07 ebbc3	5.0.1.1453 2024.08.06 1b9d0	5.0.1.1453 2024.07.30 48044	5.0.1.1453 2024.07.28 8d956	5.0.1.1429 2024.07.19 8ee90	5.0.1.1428 2024.07.15 00392	5.0.1.1428 2024.06.30 67a31	5.0.1.1415 2024.06.12 f8731	5.0.1.1415 2024.06.11 31d74	5.0.1.1401 2024.06.05 f9b76	5.0.1.1398 2024.05.10 5e3ce	5.0.1.1397 2024.05.09 ee2ef	5.0.1.1392 2024.04.29 7dbc2	5.0.1.1386 2024.04.25 c0328	5.0.1.1386 2024.04.20 80571	5.0.1.1378 2024.04.07 5292b	5.0.1.1346 2024.03.16 fe320	5.0.1.1346 2024.03.02 da408	5.0.1.1340 2024.02.17 08a71	5.0.1.1325 2024.02.06 c98fb	5.0.1.1325 2024.02.02 1d438	5.0.1.1325 2024.01.26 cffb6	5.0.1.1325 2024.01.26 d3810	Test TITLE
1	bugs core 3085 tracker	SS	599	439	371	371	325	321	321	321	311	235	235	235	235	235	234	234	234	234	219	219	218	218	218	202	202	202	Add clause ALTER DOMAIN <name> {DROP \| SET} NOT NULL
2	functional database alter 03	SS	274	X	203	203	202	201	202	202	197	157	141	140	140	140	140	140	125	124	X	124	124	124	X	X	X	X	Alter database: add file with name of this database or previously added files must fail
3	functional gtcs gtcs proc isql 08	SS	424	X	316	313	313	316	313	313	310	234	234	234	234	234	234	234	233	233	X	219	218	217	X	X	X	X	gtcs-proc-isql-08
4	functional tabloid crash when too long username for auth	SS	243	X	150	148	148	148	148	148	145	141	140	140	140	141	141	141	125	124	X	124	124	124	X	X	X	X	crash on assert or memory corruption when too long username is used for authentication
5	functional tabloid eqc 344124	SS	426	X	319	318	313	311	311	310	310	235	235	235	235	235	235	235	219	218	X	217	217	203	X	X	X	X	Check ability to run selectable SP with input parameter which inserts into GTT (on commit DELETE rows) and then does suspend

Elapsed time, milliseconds:

NN	Test name	mode	5.0.2.1489 2024.08.31 994a6	5.0.2.1476 2024.08.09 843ea	5.0.1.1454 2024.08.08 30f9f	5.0.1.1453 2024.08.07 ebbc3	5.0.1.1453 2024.08.06 1b9d0	5.0.1.1453 2024.07.30 48044	5.0.1.1453 2024.07.28 8d956	5.0.1.1429 2024.07.19 8ee90	5.0.1.1428 2024.07.15 00392	5.0.1.1428 2024.06.30 67a31	5.0.1.1415 2024.06.12 f8731	5.0.1.1415 2024.06.11 31d74	5.0.1.1401 2024.06.05 f9b76	5.0.1.1398 2024.05.10 5e3ce	5.0.1.1397 2024.05.09 ee2ef	5.0.1.1392 2024.04.29 7dbc2	5.0.1.1386 2024.04.25 c0328	5.0.1.1386 2024.04.20 80571	5.0.1.1378 2024.04.07 5292b	5.0.1.1346 2024.03.16 fe320	5.0.1.1346 2024.03.02 da408	5.0.1.1340 2024.02.17 08a71	5.0.1.1325 2024.02.06 c98fb	5.0.1.1325 2024.02.02 1d438	5.0.1.1325 2024.01.26 cffb6	5.0.1.1325 2024.01.26 d3810	5.0.1.1318 2024.01.21 a7ca3	5.0.1.1318 2024.01.21 d429d	5.0.1.1318 2024.01.21 f1ab5	5.0.1.1318 2024.01.20 46722	Test TITLE
1	bugs core 3085 tracker	SS	630	439	599	649	371	315	315	732	325	321	311	235	235	235	234	235	234	250	234	219	234	218	218	233	218	202	202	202	203	202	Add clause ALTER DOMAIN <name> {DROP \| SET} NOT NULL
2	functional database alter 03	SS	274	X	318	319	203	201	198	212	202	197	203	141	157	140	140	140	140	141	X	125	124	108	X	X	X	X	124	124	124	124	Alter database: add file with name of this database or previously added files must fail
3	functional gtcs gtcs proc isql 08	SS	425	X	435	424	311	316	305	313	318	316	310	234	234	234	235	235	234	234	X	219	233	217	X	X	X	X	233	217	218	217	gtcs-proc-isql-08
4	functional tabloid crash when too long username for auth	SS	243	X	273	267	146	150	148	148	151	145	190	141	140	140	140	141	141	147	X	125	124	124	X	X	X	X	124	108	124	108	crash on assert or memory corruption when too long username is used for authentication
5	functional tabloid eqc 344124	SS	869	X	426	458	318	319	313	311	311	310	310	234	234	235	235	235	235	235	X	219	218	217	X	X	X	X	202	202	234	203	Check ability to run selectable SP with input parameter which inserts into GTT (on commit DELETE rows) and then does suspend

Last commits information:

List of tests in this report:

http://tracker.firebirdsql.org/browse/core-3085
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_gtcs_proc_isql_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_eqc_344124.py

=== end of list ===