01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (43 rows)
07. Has fails: tests with at least one fail for previous 30 runs (45 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (9 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (2048 rows)
12. Skipped: tests which was intentionally excluded from execution (67 rows)

Generated UTC 30.03.2025 17:48
Tested: HQ30.   Build / date: 3.0.13.33803-08ebd2fe / 2025.02.25;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
508 477 473 473 473 513 513 513 299 X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46
18595 18595 3502 3502 3151 3309 3309 3151 2964 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 2022.02.02 14:46
17954 17954 2293 2293 2293 2320 2320 2323 2320 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
4 CS 2022.02.02 14:46
1053 1039 817 10 7 7 9 10 9 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 SS 2022.02.02 14:46
504 493 373 14 6 6 8 8 7 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
6 CS 2022.02.02 14:46
1124 1124 825 10 8 8 8 10 8 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 SS 2022.02.02 14:46
481 481 378 22 6 5 6 6 6 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
8 CS 2022.02.02 14:46
1307 1307 1003 28 10 10 10 7 6 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
9 SS 2022.02.02 14:46
635 635 510 14 7 6 6 6 6 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
10 SS 2022.02.02 14:46
499 499 499 520 520 527 527 527 308 X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
11 SS 2022.02.02 14:46
3184 3184 2043 2043 2043 2043 2709 2709 2044 X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
12 SS 2022.02.02 14:46
407 398 386 386 386 459 459 459 244 X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
13 CS 2022.02.02 14:46
1296 1296 936 9 9 9 9 7 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
14 SS 2022.02.02 14:46
630 630 543 10 10 8 8 8 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
15 SS 2022.02.02 14:46
4506 4506 2781 2781 2781 2781 3574 3574 2716 X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
16 SS 2024.06.09 15:53
383 357 367 367 367 468 468 468 237 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
17 SS 2022.02.02 14:46
466 462 462 482 482 570 570 570 308 X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
18 SS 2022.02.02 14:46
491 480 476 476 476 585 585 585 314 X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
19 SS 2023.12.12 17:20
540 508 508 508 519 583 583 583 327 X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
20 CS 2022.02.02 14:46
8 8 5 5 5 6 10 11 10 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 2022.02.02 14:46
1394 1357 1013 9 9 9 9 9 7 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
22 SS 2022.02.02 14:46
781 708 566 12 6 6 10 10 10 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
23 SS 2022.02.02 14:46
412 405 409 409 409 522 522 522 266 X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
24 SS 2022.02.02 14:46
503 503 447 447 447 475 475 475 298 X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
25 SS 2022.02.02 14:46
368 366 343 343 343 381 381 381 224 X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
26 CS 2022.02.02 14:46
73899 73899 46468 46468 46468 46468 77967 77967 50207 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
27 SS 2022.02.02 14:46
74149 74149 48694 48694 48694 48694 77590 77590 51990 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
28 SS 2022.02.02 14:46
481 481 467 467 467 553 553 553 311 X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
29 CS 2023.05.13 17:29
52364 52364 25596 25596 25596 41385 42381 42381 41385 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
30 SS 2023.05.13 17:29
49333 49333 26132 26132 26132 26132 41331 41331 17076 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
31 CS 2023.12.14 16:30
15996 15996 9661 9661 9661 12808 12956 12956 12808 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
32 SS 2023.12.14 16:30
14613 14613 9175 9175 9175 9175 11375 11375 7482 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
33 CS 2024.05.09 22:22
2273 2273 1454 1454 1454 1626 1626 1626 1383 X X X X X X X X X X X X X X X X X
Create database: set names and default character set
34 CS 2023.10.07 07:54
1086 1085 1080 1080 1080 1224 1224 1224 716 X X X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
35 SS 2022.02.04 18:05
440 426 416 416 416 554 554 554 258 X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
36 CS 2022.02.04 18:05
4764 4764 4244 8 6 6 6 6 6 X X X X X X X X X X X X X X X X X
LEFT function
37 SS 2022.02.04 18:05
4409 4409 3924 12 7 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
38 CS 2022.02.04 18:05
4836 4836 4297 10 7 7 7 9 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
39 SS 2022.02.04 18:05
4362 4362 3934 10 8 8 8 8 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
40 SS 2022.02.04 18:05
542 542 481 481 481 613 613 613 320 X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
41 CS 2023.10.07 10:21
5255 5255 3284 3284 3284 4710 4710 4710 4505 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
42 SS 2023.10.07 10:21
4634 4634 2754 2754 2754 2754 3400 3400 2439 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
43 SS 2023.10.09 09:14
394 364 364 364 377 458 458 458 234 X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 820 477 537 508 359 410 473 808 513 669 299 265 279 X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46 898 18595 19324 19723 2539 2831 3502 6868 3151 3309 2737 2964 2659 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 2022.02.02 14:46 443 17954 18379 18346 2113 2293 2285 5950 2320 2556 2131 2323 2137 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
4 CS 2022.02.02 14:46 1151 1053 1090 1039 817 4 7 10 7 13 9 19 6 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 SS 2022.02.02 14:46 574 504 560 493 373 6 6 14 5 15 8 7 6 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
6 CS 2022.02.02 14:46 947 1133 1163 1124 825 4 5 10 8 22 5 16 5 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 SS 2022.02.02 14:46 427 481 567 487 378 5 6 22 5 5 9 6 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
8 CS 2022.02.02 14:46 1267 1311 1307 1349 1003 5 28 10 4 15 7 6 5 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
9 SS 2022.02.02 14:46 566 635 715 649 510 5 7 14 5 6 5 11 8 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
10 SS 2022.02.02 14:46 469 500 499 524 360 410 520 942 599 527 308 286 300 X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
11 SS 2022.02.02 14:46 491 3352 3184 3547 1869 1968 2043 5960 2817 1474 2709 1302 2044 X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
12 SS 2022.02.02 14:46 428 407 398 428 305 350 386 852 459 538 234 237 244 X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
13 CS 2022.02.02 14:46 893 1317 1338 1296 936 6 9 9 7 29 6 6 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
14 SS 2022.02.02 14:46 436 630 668 674 543 7 5 10 10 8 5 5 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
15 SS 2022.02.02 14:46 519 4506 4677 4614 2652 2602 2781 8268 3956 2151 3574 2156 2716 X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
16 SS 2024.06.09 15:53 629 357 396 383 258 301 367 1688 468 476 237 184 175 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
17 SS 2022.02.02 14:46 590 466 462 516 373 433 482 1751 598 570 301 308 293 X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
18 SS 2022.02.02 14:46 639 491 513 480 389 425 476 1768 634 585 314 294 309 X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
19 SS 2023.12.12 17:20 650 540 543 508 381 445 519 1871 583 610 327 304 295 X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
20 CS 2022.02.02 14:46 939 8 9 8 5 5 5 11 6 17 10 15 10 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 2022.02.02 14:46 2276 1357 1394 1404 1013 6 6 9 9 19 7 5 5 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
22 SS 2022.02.02 14:46 1487 810 781 708 566 6 6 12 6 13 10 10 5 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
23 SS 2022.02.02 14:46 428 405 412 419 314 377 409 1205 522 563 266 231 236 X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
24 SS 2022.02.02 14:46 479 503 534 511 364 415 447 855 475 572 284 286 298 X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
25 SS 2022.02.02 14:46 866 368 405 366 296 308 343 746 381 468 224 194 193 X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
26 CS 2022.02.02 14:46 973 75736 73899 77117 44919 45188 46468 161307 77967 41670 88020 47858 50207 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
27 SS 2022.02.02 14:46 482 76386 74149 80112 46275 46636 48694 134581 77590 44981 86934 44304 51990 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
28 SS 2022.02.02 14:46 439 481 556 511 356 398 467 1371 553 609 311 274 272 X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
29 CS 2023.05.13 17:29 34289 52364 53244 54116 24779 24440 25596 90790 42381 41385 42946 3382 3372 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
30 SS 2023.05.13 17:29 31932 49333 52469 54778 24436 23882 26132 83914 41331 17076 41944 2624 2613 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
31 CS 2023.12.14 16:30 970 15996 17127 16505 9233 8952 9661 27898 14457 12808 12956 5826 8396 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
32 SS 2023.12.14 16:30 466 14613 15169 15503 8948 8458 9175 27086 12086 5516 11375 4903 7482 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
33 CS 2024.05.09 22:22 667 2273 2438 2433 1177 1454 1434 3031 1626 1660 1383 1269 1216 X X X X X X X X X X X X X X X X X
Create database: set names and default character set
34 CS 2023.10.07 07:54 1135 1085 1114 1086 807 973 1080 2096 1224 1330 670 716 711 X X X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
35 SS 2022.02.04 18:05 440 426 457 469 306 380 416 787 570 554 258 228 214 X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
36 CS 2022.02.04 18:05 928 4764 5096 4805 4244 6 6 8 6 6 6 17 6 X X X X X X X X X X X X X X X X X
LEFT function
37 SS 2022.02.04 18:05 487 4611 4440 4409 3924 5 5 12 7 10 7 5 5 X X X X X X X X X X X X X X X X X
LEFT function
38 CS 2022.02.04 18:05 965 6490 4836 4853 4297 6 5 10 7 9 5 17 5 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
39 SS 2022.02.04 18:05 451 4365 4758 4362 3934 4 7 10 8 16 7 5 6 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
40 SS 2022.02.04 18:05 493 543 544 542 371 477 481 1876 613 668 312 320 293 X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
41 CS 2023.10.07 10:21 983 5255 5474 5307 2846 3284 3130 9576 4710 5058 4505 2658 2691 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
42 SS 2023.10.07 10:21 472 4634 5010 4760 2395 2244 2754 11658 3400 2087 3938 1984 2439 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
43 SS 2023.10.09 09:14 707 394 418 364 275 287 377 1061 466 458 234 201 193 X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1
http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-2797
http://tracker.firebirdsql.org/browse/CORE-3204
http://tracker.firebirdsql.org/browse/CORE-3228
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-3732
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-4075
http://tracker.firebirdsql.org/browse/CORE-4201
http://tracker.firebirdsql.org/browse/CORE-4205
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-5905
http://tracker.firebirdsql.org/browse/CORE-6137
http://tracker.firebirdsql.org/browse/CORE-6216
http://tracker.firebirdsql.org/browse/CORE-6345
http://tracker.firebirdsql.org/browse/CORE-6486
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_33.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/alter/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_comment_in_object_names.py
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6987
=== end of list ===

Last commits information (all timestamps in UTC):