01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (7 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (36 rows)
07. Has fails: tests with at least one fail for previous 30 runs (52 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (30 rows)
11. All tests: outcomes for previous 30 runs (2085 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 27.06.2025 14:56
Tested: HQ30.   Build / date: 3.0.13.33809-28ad086f / 2025.05.06;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33809
2025.05.06
28ad0
3.0.13.33808
2025.04.25
28426
3.0.13.33803
2025.02.25
08ebd
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X
Test TITLE
1
bugs core 0001 
 tracker
 SS 2022.02.02 14:46
713 537 508 477 473 473 473 513 513 513 299 X X X X X X X X X X X X X X X
Server shutdown
2
bugs core 0856 
 tracker
 CS 2025.06.25 15:39
1090 1090 1053 1039 817 10 7 7 9 10 9 X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
3
bugs core 0856 
 tracker
 SS 2025.06.25 15:39
532 532 504 493 373 14 6 6 8 8 7 X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
1038 1124 1124 1124 825 10 8 8 8 10 8 X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
487 487 487 481 378 22 6 5 6 6 6 X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 2215 
 tracker
 CS 2022.02.02 14:46
1307 1311 1307 1307 1003 28 10 10 10 7 6 X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
7
bugs core 2215 
 tracker
 SS 2022.02.02 14:46
619 635 635 635 510 14 7 6 6 6 6 X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
8
bugs core 2797 
 tracker
 SS 2022.02.02 14:46
500 503 500 499 499 520 520 527 527 527 308 X X X X X X X X X X X X X X X
Problem with default value of SP parameter
9
bugs core 3228 
 tracker
 SS 2022.02.02 14:46
407 428 407 398 386 386 386 459 459 459 244 X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
10
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
1043 1296 1296 1296 936 9 9 9 9 7 6 X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
503 630 630 630 543 10 10 8 8 8 5 X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
12
bugs core 4054 
 tracker
 SS 2024.06.09 15:53
542 396 383 357 367 367 367 468 468 468 237 X X X X X X X X X X X X X X X
role not passed on external execute stmt
13
bugs core 4075 
 tracker
 SS 2022.02.02 14:46
596 516 466 462 462 482 482 570 570 570 308 X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
14
bugs core 4201 
 tracker
 SS 2022.02.02 14:46
554 513 491 480 476 476 476 585 585 585 314 X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
15
bugs core 4205 
 tracker
 SS 2023.12.12 17:20
639 543 540 508 508 508 519 583 583 583 327 X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
16
bugs core 5225 
 tracker
 SS 2024.06.09 15:53
1237 1296 1237 543 491 491 491 608 698 698 608 X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
17
bugs core 5270 
 tracker
 SS 2022.02.02 14:46
384 9 6 6 6 7 7 9 9 9 7 X X X X X X X X X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
18
bugs core 5414 
 tracker
 CS 2022.02.02 14:46
803 9 8 8 5 5 5 6 10 11 10 X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
19
bugs core 5457 
 tracker
 CS 2022.02.02 14:46
1986 1404 1394 1357 1013 9 9 9 9 9 7 X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
20
bugs core 5457 
 tracker
 SS 2022.02.02 14:46
1439 810 781 708 566 12 6 6 10 10 10 X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
21
bugs core 5905 
 tracker
 SS 2022.02.02 14:46
446 419 412 405 409 409 409 522 522 522 266 X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
22
bugs core 5965 
 tracker
 SS 2022.02.02 14:46
2201 2201 1164 1140 1087 1087 1087 1422 1422 1422 919 X X X X X X X X X X X X X X X
FB3 Optimiser chooses less efficient plan than FB2.5 optimiser
23
bugs core 6137 
 tracker
 SS 2022.02.02 14:46
506 511 506 503 447 447 447 475 475 475 298 X X X X X X X X X X X X X X X
Server crashes when it run SQL
24
bugs core 6216 
 tracker
 SS 2022.02.02 14:46
888 405 368 366 343 343 343 381 381 381 224 X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
25
bugs core 6486 
 tracker
 SS 2022.02.02 14:46
501 504 504 481 467 467 467 553 553 553 311 X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
26
functional arno optimizer opt sort by index 19 
 SS 2022.02.04 18:05
487 10 6 6 6 6 6 7 9 9 8 X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
27
functional domain create 33 
 CS 2023.10.07 07:54
1085 1086 1086 1085 1080 1080 1080 1224 1224 1224 716 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
28
functional domain create 34 
 CS 2023.10.07 07:53
818 11 7 7 7 7 7 7 7 7 7 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
29
functional intfunc date dateadd 06 
 SS 2022.02.04 18:05
482 484 482 475 475 475 475 575 575 575 316 X X X X X X X X X X X X X X X
DATEADD
30
functional intfunc string ascii 01 
 SS 2022.02.04 18:05
457 469 457 426 416 416 416 554 554 554 258 X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
31
functional intfunc string left 01 
 CS 2022.02.04 18:05
1040 4764 4764 4764 4244 8 6 6 6 6 6 X X X X X X X X X X X X X X X
LEFT function
32
functional intfunc string left 01 
 SS 2022.02.04 18:05
488 4409 4409 4409 3924 12 7 7 7 7 7 X X X X X X X X X X X X X X X
LEFT function
33
functional intfunc string right 01 
 CS 2022.02.04 18:05
1075 4836 4836 4836 4297 10 7 7 7 9 7 X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
34
functional intfunc string right 01 
 SS 2022.02.04 18:05
474 4362 4362 4362 3934 10 8 8 8 8 7 X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
35
functional procedure create 01 
 SS 2022.02.04 18:05
543 543 542 542 481 481 481 613 613 613 320 X X X X X X X X X X X X X X X
CREATE PROCEDURE
36
functional tabloid comment in object names 
 SS 2023.10.09 09:14
601 418 394 364 364 364 377 458 458 458 234 X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33809
2025.05.06
28ad0
3.0.13.33808
2025.04.25
28426
3.0.13.33803
2025.02.25
08ebd
3.0.13.33796
2025.01.29
0ab85
3.0.13.33796
2025.01.14
99b3b
3.0.13.33795
2024.11.24
b8847
3.0.13.33794
2024.10.15
abe09
3.0.13.33793
2024.10.04
82ccc
3.0.13.33792
2024.08.31
d8791
3.0.13.33787
2024.08.17
2e0d6
3.0.13.33787
2024.08.09
df740
3.0.12.33746
2024.07.15
11dd4
3.0.12.33746
2024.06.11
8a5eb
3.0.12.33744
2024.05.09
9cf37
3.0.12.33744
2024.04.20
af6b2
X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0001 
 tracker
 SS 2022.02.02 14:46 713 906 853 477 537 508 359 410 473 808 513 669 299 265 279 X X X X X X X X X X X X X X X
Server shutdown
2
bugs core 0856 
 tracker
 CS 2025.06.25 15:39 989 1224 1163 1053 1090 1039 817 4 7 10 7 13 9 19 6 X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
3
bugs core 0856 
 tracker
 SS 2025.06.25 15:39 427 577 532 504 560 493 373 6 6 14 5 15 8 7 6 X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 784 1038 996 1133 1163 1124 825 4 5 10 8 22 5 16 5 X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 438 487 500 481 567 487 378 5 6 22 5 5 9 6 7 X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 2215 
 tracker
 CS 2022.02.02 14:46 1092 1390 1231 1311 1307 1349 1003 5 28 10 4 15 7 6 5 X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
7
bugs core 2215 
 tracker
 SS 2022.02.02 14:46 561 619 576 635 715 649 510 5 7 14 5 6 5 11 8 X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
8
bugs core 2797 
 tracker
 SS 2022.02.02 14:46 452 503 556 500 499 524 360 410 520 942 599 527 308 286 300 X X X X X X X X X X X X X X X
Problem with default value of SP parameter
9
bugs core 3228 
 tracker
 SS 2022.02.02 14:46 368 512 493 407 398 428 305 350 386 852 459 538 234 237 244 X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
10
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 838 1043 1031 1317 1338 1296 936 6 9 9 7 29 6 6 6 X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 386 499 503 630 668 674 543 7 5 10 10 8 5 5 5 X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
12
bugs core 4054 
 tracker
 SS 2024.06.09 15:53 542 656 701 357 396 383 258 301 367 1688 468 476 237 184 175 X X X X X X X X X X X X X X X
role not passed on external execute stmt
13
bugs core 4075 
 tracker
 SS 2022.02.02 14:46 596 689 683 466 462 516 373 433 482 1751 598 570 301 308 293 X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
14
bugs core 4201 
 tracker
 SS 2022.02.02 14:46 554 639 663 491 513 480 389 425 476 1768 634 585 314 294 309 X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
15
bugs core 4205 
 tracker
 SS 2023.12.12 17:20 639 666 727 540 543 508 381 445 519 1871 583 610 327 304 295 X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
16
bugs core 5225 
 tracker
 SS 2024.06.09 15:53 1036 1296 1237 1586 543 1565 426 462 491 861 608 1488 698 20 6 X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
17
bugs core 5270 
 tracker
 SS 2022.02.02 14:46 384 452 439 6 6 9 5 7 6 13 9 23 7 5 7 X X X X X X X X X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
18
bugs core 5414 
 tracker
 CS 2022.02.02 14:46 803 1046 1029 8 9 8 5 5 5 11 6 17 10 15 10 X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
19
bugs core 5457 
 tracker
 CS 2022.02.02 14:46 1986 2357 2190 1357 1394 1404 1013 6 6 9 9 19 7 5 5 X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
20
bugs core 5457 
 tracker
 SS 2022.02.02 14:46 1439 1491 1502 810 781 708 566 6 6 12 6 13 10 10 5 X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
21
bugs core 5905 
 tracker
 SS 2022.02.02 14:46 446 602 567 405 412 419 314 377 409 1205 522 563 266 231 236 X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
22
bugs core 5965 
 tracker
 SS 2022.02.02 14:46 1924 2407 2385 2201 1164 1140 886 1016 1087 2000 1422 1535 919 754 768 X X X X X X X X X X X X X X X
FB3 Optimiser chooses less efficient plan than FB2.5 optimiser
23
bugs core 6137 
 tracker
 SS 2022.02.02 14:46 455 563 506 503 534 511 364 415 447 855 475 572 284 286 298 X X X X X X X X X X X X X X X
Server crashes when it run SQL
24
bugs core 6216 
 tracker
 SS 2022.02.02 14:46 888 1030 1018 368 405 366 296 308 343 746 381 468 224 194 193 X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
25
bugs core 6486 
 tracker
 SS 2022.02.02 14:46 458 501 504 481 556 511 356 398 467 1371 553 609 311 274 272 X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
26
functional arno optimizer opt sort by index 19 
 SS 2022.02.04 18:05 487 576 524 6 10 6 5 6 6 11 7 16 9 8 6 X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
27
functional domain create 33 
 CS 2023.10.07 07:54 795 1041 1148 1085 1114 1086 807 973 1080 2096 1224 1330 670 716 711 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT NULL
28
functional domain create 34 
 CS 2023.10.07 07:53 818 1120 1069 6 7 11 7 5 5 11 7 9 7 5 6 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
29
functional intfunc date dateadd 06 
 SS 2022.02.04 18:05 411 540 482 404 500 484 382 475 418 1013 575 595 314 316 277 X X X X X X X X X X X X X X X
DATEADD
30
functional intfunc string ascii 01 
 SS 2022.02.04 18:05 435 536 497 426 457 469 306 380 416 787 570 554 258 228 214 X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
31
functional intfunc string left 01 
 CS 2022.02.04 18:05 849 1040 1012 4764 5096 4805 4244 6 6 8 6 6 6 17 6 X X X X X X X X X X X X X X X
LEFT function
32
functional intfunc string left 01 
 SS 2022.02.04 18:05 432 484 488 4611 4440 4409 3924 5 5 12 7 10 7 5 5 X X X X X X X X X X X X X X X
LEFT function
33
functional intfunc string right 01 
 CS 2022.02.04 18:05 803 1075 1000 6490 4836 4853 4297 6 5 10 7 9 5 17 5 X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
34
functional intfunc string right 01 
 SS 2022.02.04 18:05 409 474 469 4365 4758 4362 3934 4 7 10 8 16 7 5 6 X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
35
functional procedure create 01 
 SS 2022.02.04 18:05 425 563 532 543 544 542 371 477 481 1876 613 668 312 320 293 X X X X X X X X X X X X X X X
CREATE PROCEDURE
36
functional tabloid comment in object names 
 SS 2023.10.09 09:14 601 777 760 394 418 364 275 287 377 1061 466 458 234 201 193 X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1
http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-2797
http://tracker.firebirdsql.org/browse/CORE-3228
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-4075
http://tracker.firebirdsql.org/browse/CORE-4201
http://tracker.firebirdsql.org/browse/CORE-4205
http://tracker.firebirdsql.org/browse/CORE-5225
http://tracker.firebirdsql.org/browse/CORE-5270
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-5905
http://tracker.firebirdsql.org/browse/CORE-5965
http://tracker.firebirdsql.org/browse/CORE-6137
http://tracker.firebirdsql.org/browse/CORE-6216
http://tracker.firebirdsql.org/browse/CORE-6486
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_33.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_34.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/date/test_dateadd_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_comment_in_object_names.py
=== end of list ===

Last commits information (all timestamps in UTC):