01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (15 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (33 rows)
07. Has fails: tests with at least one fail for previous 30 runs (44 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2044 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated UTC 22.02.2025 13:54
Tested: HQ30.   Build / date: 3.0.13.33796-0ab85166 / 2025.01.29;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46
19324 3502 3502 3151 3309 3309 3151 2964 X X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46
17957 2293 2293 2293 2320 2320 2323 2320 X X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 1005 
 tracker
 SS 2022.02.02 14:46
3328 2054 2054 2054 2054 2796 2796 1979 X X X X X X X X X X X X X X X X X X
DISTINCT vs NULLS LAST clause: wrong order of NULLs
4
bugs core 3204 
 tracker
 SS 2022.02.02 14:46
3184 2043 2043 2043 2043 2709 2709 2044 X X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
5
bugs core 3732 
 tracker
 SS 2022.02.02 14:46
4614 2781 2781 2781 2781 3574 3574 2716 X X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
6
bugs core 5414 
 tracker
 CS 2022.02.02 14:46
8 5 5 5 6 10 11 10 X X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
7
bugs core 6345 
 tracker
 CS 2022.02.02 14:46
73899 46468 46468 46468 46468 77967 77967 50207 X X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
8
bugs core 6345 
 tracker
 SS 2022.02.02 14:46
74149 48694 48694 48694 48694 77590 77590 51990 X X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
9
bugs gh 6220 
 tracker
 CS 2023.05.13 17:29
53244 25596 25596 25596 41385 42381 42381 41385 X X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
10
bugs gh 6987 
 tracker
 CS 2023.12.14 16:30
16505 9661 9661 9661 12808 12956 12956 12808 X X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
11
bugs gh 6987 
 tracker
 SS 2023.12.14 16:30
15169 9175 9175 9175 9175 11375 11375 7482 X X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
12
functional database create 01 
 CS 2024.05.09 22:22
2340 1454 1454 1454 1626 1626 1626 1383 X X X X X X X X X X X X X X X X X X
Create database: set names and default character set
13
functional gtcs external file 09 d 
 SS 2022.07.31 08:08
2254 1453 1453 1453 1453 1730 1730 1357 X X X X X X X X X X X X X X X X X X
Test for external table with field of DATE datatype
14
functional table alter 11 
 CS 2023.10.07 10:21
5307 3284 3284 3284 4710 4710 4710 4505 X X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
15
functional table alter 11 
 SS 2023.10.07 10:21
4760 2754 2754 2754 2754 3400 3400 2439 X X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE

Elapsed time, milliseconds:

NN Test name mode
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0211 
 tracker
 CS 20509 19324 19723 2539 2831 3502 6868 3151 3309 2737 2964 2659 X X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 17957 18379 18346 2113 2293 2285 5950 2320 2556 2131 2323 2137 X X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 1005 
 tracker
 SS 4026 3464 3328 2049 1980 2054 8741 2796 1914 2919 1494 1979 X X X X X X X X X X X X X X X X X X
DISTINCT vs NULLS LAST clause: wrong order of NULLs
4
bugs core 3204 
 tracker
 SS 3753 3184 3547 1869 1968 2043 5960 2817 1474 2709 1302 2044 X X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
5
bugs core 3732 
 tracker
 SS 5018 4677 4614 2652 2602 2781 8268 3956 2151 3574 2156 2716 X X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
6
bugs core 5414 
 tracker
 CS 8 9 8 5 5 5 11 6 17 10 15 10 X X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
7
bugs core 6345 
 tracker
 CS 83135 73899 77117 44919 45188 46468 161307 77967 41670 88020 47858 50207 X X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
8
bugs core 6345 
 tracker
 SS 84124 74149 80112 46275 46636 48694 134581 77590 44981 86934 44304 51990 X X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
9
bugs gh 6220 
 tracker
 CS 61090 53244 54116 24779 24440 25596 90790 42381 41385 42946 3382 3372 X X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
10
bugs gh 6987 
 tracker
 CS 19053 17127 16505 9233 8952 9661 27898 14457 12808 12956 5826 8396 X X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
11
bugs gh 6987 
 tracker
 SS 15858 15169 15503 8948 8458 9175 27086 12086 5516 11375 4903 7482 X X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
12
functional database create 01 
 CS 2340 2438 2433 1177 1454 1434 3031 1626 1660 1383 1269 1216 X X X X X X X X X X X X X X X X X X
Create database: set names and default character set
13
functional gtcs external file 09 d 
 SS 2482 2254 2405 1311 1248 1453 4120 2190 1357 1730 1035 1256 X X X X X X X X X X X X X X X X X X
Test for external table with field of DATE datatype
14
functional table alter 11 
 CS 5528 5474 5307 2846 3284 3130 9576 4710 5058 4505 2658 2691 X X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
15
functional table alter 11 
 SS 5197 5010 4760 2395 2244 2754 11658 3400 2087 3938 1984 2439 X X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1005
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-3204
http://tracker.firebirdsql.org/browse/CORE-3732
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-6345
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_external_file_09_d.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/alter/test_11.py
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6987
=== end of list ===

Last commits information (all timestamps in UTC):