01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (28 rows)
07. Has fails: tests with at least one fail for previous 35 runs (65 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (183 rows)
11. All tests: outcomes for previous 35 runs (2703 rows)
12. Skipped: tests which was intentionally excluded from execution (169 rows)

Generated UTC 01.10.2025 18:08
Tested: HQ40.   Build / date: 4.0.6.3223-970bec8a / 2025.08.18;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3223
2025.08.18
970be
4.0.6.3222
2025.07.22
685b7
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26
41087 15102 14686 14562 9377 9289 9289 9289 9691 12385 12385 X 12385 9206 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26
38706 14646 14638 14423 8971 8879 8879 8971 9507 12582 12582 12582 12301 9203 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2025.06.25 15:39
737 720 665 654 523 519 516 7 7 7 9 9 9 8 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2025.06.25 15:39
522 500 466 423 396 373 339 11 11 8 10 10 8 8 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
714 714 684 684 579 561 541 13 13 7 9 9 7 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
494 469 469 469 418 383 372 8 8 6 8 8 5 5 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2025.06.26 15:41
913 907 826 763 704 672 642 12 12 7 6 6 6 6 X X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2025.06.26 15:41
675 611 603 594 449 448 444 15 9 8 9 8 7 7 X X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
747 747 747 747 702 648 632 13 6 6 6 6 6 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
600 588 588 588 478 478 475 10 8 8 8 8 7 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53
509 362 335 292 262 258 258 262 277 361 361 361 317 162 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53
1713 1043 1024 996 805 785 785 805 843 998 998 998 762 8 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53
1088 573 558 517 438 405 405 438 462 561 562 562 561 6 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5414 
 tracker
 CS 2022.02.02 14:46
602 12 7 6 6 6 6 7 9 9 9 9 8 5 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
15
bugs core 5431 
 tracker
 SS 2025.07.01 19:02
396 346 337 331 260 253 253 253 265 324 324 324 311 168 X X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
16
bugs core 5463 
 tracker
 CS 2025.07.01 19:15
894 894 894 894 718 703 685 17 10 10 8 8 7 6 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs core 5463 
 tracker
 SS 2025.07.01 19:15
649 641 641 641 530 520 519 20 9 9 9 9 7 7 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
18
bugs core 6138 
 tracker
 SS 2022.02.02 14:46
409 10 10 8 5 5 5 5 6 6 6 5 5 5 X X X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
19
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06
57303 54558 54558 54558 39829 39829 39829 41537 41537 41537 4807 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06
56258 56258 56258 56258 40651 40651 40651 43047 43047 43047 3038 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
21
bugs gh 7140 
 tracker
 CS 2024.12.29 06:59
1050 3113 3113 3113 2933 2933 2933 2937 3021 3217 3217 3217 2869 640 X X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
22
bugs gh 7140 
 tracker
 SS 2024.12.29 06:59
675 2720 2720 2720 2699 2680 2667 2680 2680 2771 2771 2771 2616 450 X X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
23
functional database create 02 
 SS 2025.01.13 11:44
1077 14 8 7 6 5 5 6 8 8 9 8 6 5 X X X X X X X X X X X X X X X X X
Create database: non sysdba user
24
functional intfunc string left 01 
 CS 2022.02.04 18:05
865 4211 4211 4211 4211 4046 4013 11 11 11 11 9 9 9 X X X X X X X X X X X X X X X X X
LEFT function
25
functional intfunc string left 01 
 SS 2022.02.04 18:05
546 4074 4074 4290 4290 3942 3929 12 9 7 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
26
functional intfunc string right 01 
 CS 2022.02.04 18:05
902 4244 4244 4244 4244 4131 3999 16 14 10 10 10 10 10 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
27
functional intfunc string right 01 
 SS 2022.02.04 18:05
630 4139 4139 4139 4128 3867 3859 8 8 6 8 8 6 6 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
28
functional table create 01 
 CS 2023.10.07 10:57
790 14 8 8 6 6 6 6 5 6 5 6 6 6 X X X X X X X X X X X X X X X X X
CREATE TABLE - types

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3223
2025.08.18
970be
4.0.6.3222
2025.07.22
685b7
4.0.6.3189
2025.02.25
1a1a5
4.0.6.3184
2025.02.24
9388c
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26 62111 41087 41215 15102 14562 14686 9377 9207 9289 7994 9691 X 12385 13028 12534 9206 8182 8704 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26 63574 40739 38706 14638 14646 14423 8879 8249 8971 8632 9507 18346 12685 12582 12301 9203 8270 8703 X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2025.06.25 15:39 1184 759 665 720 737 654 516 519 523 6 5 7 9 9 9 5 8 7 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2025.06.25 15:39 786 527 522 500 423 466 373 339 396 5 7 11 13 8 10 5 6 9 X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 924 736 532 684 714 722 579 541 561 5 6 13 13 7 9 7 7 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 578 398 413 553 494 469 418 372 383 6 6 8 9 5 9 5 5 7 X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2025.06.26 15:41 1261 996 907 826 913 763 704 642 672 7 6 12 13 5 5 6 7 6 X X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2025.06.26 15:41 868 705 675 603 611 594 449 448 444 5 9 15 8 7 11 6 6 8 X X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 936 676 565 937 747 895 632 648 702 5 6 13 5 6 4 7 6 5 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 624 424 379 600 620 588 478 475 478 8 5 10 8 7 11 5 5 6 X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53 673 509 543 292 362 335 258 262 218 240 277 580 362 361 162 317 158 151 X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53 2680 1713 1947 1043 996 1024 776 805 785 783 843 1424 998 1131 762 8 7 5 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53 1607 1186 1088 558 573 517 405 405 438 394 462 772 561 642 562 6 5 5 X X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5414 
 tracker
 CS 2022.02.02 14:46 840 602 646 12 6 7 6 5 7 6 9 11 9 8 13 5 5 5 X X X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
15
bugs core 5431 
 tracker
 SS 2025.07.01 19:02 663 468 396 346 331 337 260 247 253 220 265 523 335 324 168 311 128 134 X X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
16
bugs core 5463 
 tracker
 CS 2025.07.01 19:15 1000 720 617 904 894 940 703 718 685 17 6 10 7 11 8 6 6 6 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs core 5463 
 tracker
 SS 2025.07.01 19:15 698 454 439 649 730 641 520 519 530 7 6 20 9 11 7 6 6 7 X X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
18
bugs core 6138 
 tracker
 SS 2022.02.02 14:46 646 450 409 8 10 10 5 5 5 5 6 12 6 5 5 5 6 6 X X X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
19
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06 70764 44484 39672 57303 57676 54558 39750 39301 39829 41537 45033 93011 3507 4807 2957 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06 61845 43189 37690 56258 57063 57340 39595 39799 40651 43047 45948 96442 2960 3038 2578 X X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
21
bugs gh 7140 
 tracker
 CS 2024.12.29 06:59 1050 679 648 3113 3154 3127 2933 2894 2929 2937 3021 3496 3217 3646 2869 640 422 390 X X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
22
bugs gh 7140 
 tracker
 SS 2024.12.29 06:59 675 482 477 2841 2768 2720 2664 2699 2667 2680 2666 3082 2823 2771 2616 450 259 303 X X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
23
functional database create 02 
 SS 2025.01.13 11:44 1536 1104 1077 14 7 8 5 6 5 5 9 12 8 5 12 5 6 4 X X X X X X X X X X X X X X X X X
Create database: non sysdba user
24
functional intfunc string left 01 
 CS 2022.02.04 18:05 865 583 554 4466 4615 4211 4046 4013 4301 6 11 11 9 20 9 5 11 5 X X X X X X X X X X X X X X X X X
LEFT function
25
functional intfunc string left 01 
 SS 2022.02.04 18:05 546 420 411 4074 4362 4290 3942 4636 3929 6 7 12 9 6 7 7 7 7 X X X X X X X X X X X X X X X X X
LEFT function
26
functional intfunc string right 01 
 CS 2022.02.04 18:05 902 620 581 4574 5287 4244 4131 3999 4249 5 6 16 14 10 10 5 11 5 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
27
functional intfunc string right 01 
 SS 2022.02.04 18:05 630 404 437 4139 4583 4223 3859 4128 3867 6 5 8 9 5 9 5 6 7 X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
28
functional table create 01 
 CS 2023.10.07 10:57 1373 852 790 8 8 14 6 6 5 6 5 11 5 7 5 6 6 5 X X X X X X X X X X X X X X X X X
CREATE TABLE - types

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-5225
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5431
http://tracker.firebirdsql.org/browse/CORE-5463
http://tracker.firebirdsql.org/browse/CORE-6138
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_01.py
https://github.com/FirebirdSQL/firebird/issues/6609
https://github.com/FirebirdSQL/firebird/issues/7140
=== end of list ===

Last commits information (all timestamps in UTC):