01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (5 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (44 rows)
07. Has fails: tests with at least one fail for previous 30 runs (49 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (9 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (3 rows)
11. All tests: outcomes for previous 30 runs (2053 rows)
12. Skipped: tests which was intentionally excluded from execution (67 rows)

Generated UTC 18.04.2025 17:40
Tested: HQ30.   Build / date: 3.0.13.33803-08ebd2fe / 2025.02.25;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
508 477 473 473 473 513 513 513 299 X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46
18595 18595 3502 3502 3151 3309 3309 3151 2964 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 2022.02.02 14:46
17954 17954 2293 2293 2293 2320 2320 2323 2320 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
4 CS 2022.02.02 14:46
1053 1039 817 10 7 7 9 10 9 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 SS 2022.02.02 14:46
504 493 373 14 6 6 8 8 7 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
6 CS 2022.02.02 14:46
1124 1124 825 10 8 8 8 10 8 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 SS 2022.02.02 14:46
487 481 378 22 6 5 6 6 6 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
8 CS 2022.02.02 14:46
1307 1307 1003 28 10 10 10 7 6 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
9 SS 2022.02.02 14:46
635 635 510 14 7 6 6 6 6 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
10 SS 2022.02.02 14:46
500 499 499 520 520 527 527 527 308 X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
11 SS 2022.02.02 14:46
3184 3184 2043 2043 2043 2043 2709 2709 2044 X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
12 SS 2022.02.02 14:46
407 398 386 386 386 459 459 459 244 X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
13 CS 2022.02.02 14:46
1296 1296 936 9 9 9 9 7 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
14 SS 2022.02.02 14:46
630 630 543 10 10 8 8 8 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
15 SS 2022.02.02 14:46
4506 4506 2781 2781 2781 2781 3574 3574 2716 X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
16 SS 2024.06.09 15:53
383 357 367 367 367 468 468 468 237 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
17 SS 2022.02.02 14:46
466 462 462 482 482 570 570 570 308 X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
18 SS 2022.02.02 14:46
491 480 476 476 476 585 585 585 314 X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
19 SS 2023.12.12 17:20
540 508 508 508 519 583 583 583 327 X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
20 CS 2022.02.02 14:46
8 8 5 5 5 6 10 11 10 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 2022.02.02 14:46
1394 1357 1013 9 9 9 9 9 7 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
22 SS 2022.02.02 14:46
781 708 566 12 6 6 10 10 10 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
23 SS 2022.02.02 14:46
412 405 409 409 409 522 522 522 266 X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
24 SS 2022.02.02 14:46
511 503 447 447 447 475 475 475 298 X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
25 SS 2022.02.02 14:46
368 366 343 343 343 381 381 381 224 X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
26 CS 2022.02.02 14:46
73899 73899 46468 46468 46468 46468 77967 77967 50207 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
27 SS 2022.02.02 14:46
74149 74149 48694 48694 48694 48694 77590 77590 51990 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
28 SS 2022.02.02 14:46
507 481 467 467 467 553 553 553 311 X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
29 CS 2023.05.13 17:29
52364 52364 25596 25596 25596 41385 42381 42381 41385 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
30 SS 2023.05.13 17:29
49333 49333 26132 26132 26132 26132 41331 41331 17076 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
31 CS 2023.12.14 16:30
15996 15996 9661 9661 9661 12808 12956 12956 12808 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
32 SS 2023.12.14 16:30
14613 14613 9175 9175 9175 9175 11375 11375 7482 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
33 CS 2024.05.09 22:22
2273 2273 1454 1454 1454 1626 1626 1626 1383 X X X X X X X X X X X X X X X X X
Create database: set names and default character set
34 CS 2023.10.07 07:54
1085 1085 1080 1080 1080 1224 1224 1224 716 X X X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
35 SS 2022.02.04 18:05
484 475 475 475 475 575 575 575 316 X X X X X X X X X X X X X X X X X
DATEADD
36 SS 2022.02.04 18:05
452 426 416 416 416 554 554 554 258 X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
37 CS 2022.02.04 18:05
4764 4764 4244 8 6 6 6 6 6 X X X X X X X X X X X X X X X X X
LEFT function
38 SS 2022.02.04 18:05
4409 4409 3924 12 7 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
39 CS 2022.02.04 18:05
4836 4836 4297 10 7 7 7 9 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
40 SS 2022.02.04 18:05
4362 4362 3934 10 8 8 8 8 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
41 SS 2022.02.04 18:05
542 542 481 481 481 613 613 613 320 X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
42 CS 2023.10.07 10:21
5255 5255 3284 3284 3284 4710 4710 4710 4505 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
43 SS 2023.10.07 10:21
4634 4634 2754 2754 2754 2754 3400 3400 2439 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
44 SS 2023.10.09 09:14
394 364 364 364 377 458 458 458 234 X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 824 477 537 508 359 410 473 808 513 669 299 265 279 X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46 1042 18595 19324 19723 2539 2831 3502 6868 3151 3309 2737 2964 2659 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 SS 2022.02.02 14:46 439 17954 18379 18346 2113 2293 2285 5950 2320 2556 2131 2323 2137 X X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
4 CS 2022.02.02 14:46 1177 1053 1090 1039 817 4 7 10 7 13 9 19 6 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 SS 2022.02.02 14:46 618 504 560 493 373 6 6 14 5 15 8 7 6 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
6 CS 2022.02.02 14:46 1099 1133 1163 1124 825 4 5 10 8 22 5 16 5 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 SS 2022.02.02 14:46 496 481 567 487 378 5 6 22 5 5 9 6 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
8 CS 2022.02.02 14:46 1241 1311 1307 1349 1003 5 28 10 4 15 7 6 5 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
9 SS 2022.02.02 14:46 630 635 715 649 510 5 7 14 5 6 5 11 8 X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
10 SS 2022.02.02 14:46 521 500 499 524 360 410 520 942 599 527 308 286 300 X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
11 SS 2022.02.02 14:46 461 3352 3184 3547 1869 1968 2043 5960 2817 1474 2709 1302 2044 X X X X X X X X X X X X X X X X X
Constraint violation error of CAST is not raised inside views
12 SS 2022.02.02 14:46 468 407 398 428 305 350 386 852 459 538 234 237 244 X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
13 CS 2022.02.02 14:46 992 1317 1338 1296 936 6 9 9 7 29 6 6 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
14 SS 2022.02.02 14:46 510 630 668 674 543 7 5 10 10 8 5 5 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
15 SS 2022.02.02 14:46 544 4506 4677 4614 2652 2602 2781 8268 3956 2151 3574 2156 2716 X X X X X X X X X X X X X X X X X
Segfault when closing attachment to database
16 SS 2024.06.09 15:53 668 357 396 383 258 301 367 1688 468 476 237 184 175 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
17 SS 2022.02.02 14:46 662 466 462 516 373 433 482 1751 598 570 301 308 293 X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
18 SS 2022.02.02 14:46 579 491 513 480 389 425 476 1768 634 585 314 294 309 X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
19 SS 2023.12.12 17:20 639 540 543 508 381 445 519 1871 583 610 327 304 295 X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
20 CS 2022.02.02 14:46 1095 8 9 8 5 5 5 11 6 17 10 15 10 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 2022.02.02 14:46 2212 1357 1394 1404 1013 6 6 9 9 19 7 5 5 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
22 SS 2022.02.02 14:46 1528 810 781 708 566 6 6 12 6 13 10 10 5 X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
23 SS 2022.02.02 14:46 562 405 412 419 314 377 409 1205 522 563 266 231 236 X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
24 SS 2022.02.02 14:46 519 503 534 511 364 415 447 855 475 572 284 286 298 X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
25 SS 2022.02.02 14:46 994 368 405 366 296 308 343 746 381 468 224 194 193 X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
26 CS 2022.02.02 14:46 1079 75736 73899 77117 44919 45188 46468 161307 77967 41670 88020 47858 50207 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
27 SS 2022.02.02 14:46 515 76386 74149 80112 46275 46636 48694 134581 77590 44981 86934 44304 51990 X X X X X X X X X X X X X X X X X
Server crashes on overflow of division result
28 SS 2022.02.02 14:46 507 481 556 511 356 398 467 1371 553 609 311 274 272 X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
29 CS 2023.05.13 17:29 35516 52364 53244 54116 24779 24440 25596 90790 42381 41385 42946 3382 3372 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
30 SS 2023.05.13 17:29 33714 49333 52469 54778 24436 23882 26132 83914 41331 17076 41944 2624 2613 X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
31 CS 2023.12.14 16:30 969 15996 17127 16505 9233 8952 9661 27898 14457 12808 12956 5826 8396 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
32 SS 2023.12.14 16:30 454 14613 15169 15503 8948 8458 9175 27086 12086 5516 11375 4903 7482 X X X X X X X X X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
33 CS 2024.05.09 22:22 728 2273 2438 2433 1177 1454 1434 3031 1626 1660 1383 1269 1216 X X X X X X X X X X X X X X X X X
Create database: set names and default character set
34 CS 2023.10.07 07:54 1022 1085 1114 1086 807 973 1080 2096 1224 1330 670 716 711 X X X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
35 SS 2022.02.04 18:05 488 404 500 484 382 475 418 1013 575 595 314 316 277 X X X X X X X X X X X X X X X X X
DATEADD
36 SS 2022.02.04 18:05 452 426 457 469 306 380 416 787 570 554 258 228 214 X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
37 CS 2022.02.04 18:05 1038 4764 5096 4805 4244 6 6 8 6 6 6 17 6 X X X X X X X X X X X X X X X X X
LEFT function
38 SS 2022.02.04 18:05 430 4611 4440 4409 3924 5 5 12 7 10 7 5 5 X X X X X X X X X X X X X X X X X
LEFT function
39 CS 2022.02.04 18:05 1010 6490 4836 4853 4297 6 5 10 7 9 5 17 5 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
40 SS 2022.02.04 18:05 472 4365 4758 4362 3934 4 7 10 8 16 7 5 6 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
41 SS 2022.02.04 18:05 488 543 544 542 371 477 481 1876 613 668 312 320 293 X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
42 CS 2023.10.07 10:21 1039 5255 5474 5307 2846 3284 3130 9576 4710 5058 4505 2658 2691 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
43 SS 2023.10.07 10:21 559 4634 5010 4760 2395 2244 2754 11658 3400 2087 3938 1984 2439 X X X X X X X X X X X X X X X X X
ALTER TABLE - DROP CONSTRAINT - UNIQUE
44 SS 2023.10.09 09:14 684 394 418 364 275 287 377 1061 466 458 234 201 193 X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1
http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-2797
http://tracker.firebirdsql.org/browse/CORE-3204
http://tracker.firebirdsql.org/browse/CORE-3228
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-3732
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-4075
http://tracker.firebirdsql.org/browse/CORE-4201
http://tracker.firebirdsql.org/browse/CORE-4205
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-5905
http://tracker.firebirdsql.org/browse/CORE-6137
http://tracker.firebirdsql.org/browse/CORE-6216
http://tracker.firebirdsql.org/browse/CORE-6345
http://tracker.firebirdsql.org/browse/CORE-6486
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_33.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/date/test_dateadd_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/alter/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_comment_in_object_names.py
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6987
=== end of list ===

Last commits information (all timestamps in UTC):