01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (28 rows)
07. Has fails: tests with at least one fail for previous 30 runs (20 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2435 rows)
12. Skipped: tests which was intentionally excluded from execution (72 rows)

Generated UTC 17.01.2025 06:18
Tested: FB40.   Build / date: 4.0.6.3176-79cc1f11 / 2025.01.16;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
4.0.6.3170
2024.12.02
68abd
4.0.6.3169
2024.11.28
1673f
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46
42905 36269 36269 36269 36269 36269 2508 2508 2498 2498 2619 2619 2619 2665 2619 2665 2929 4146 4146 4265 4265 4505 4265 4265 2769 2706
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46
41918 35938 35938 35938 35938 35938 2339 2339 2339 2363 2393 2503 2578 2578 2550 2578 3177 3753 4111 4211 4111 4211 4211 3776 2570 2514
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46
680 543 543 530 525 543 536 521 521 6 6 5 6 7 7 7 7 9 10 10 11 11 11 10 9 9
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46
454 374 372 369 369 369 365 360 343 19 7 7 6 6 6 6 6 7 9 9 9 9 11 11 11 11
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
687 555 555 545 528 528 528 527 526 18 17 7 7 7 6 6 7 8 8 9 9 9 9 9 8 8
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
448 386 386 386 385 385 373 356 352 24 12 7 7 6 6 6 7 9 11 12 12 13 13 12 8 7
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46
787 649 649 638 649 638 648 638 631 11 9 5 5 7 6 6 7 7 8 8 8 8 8 7 7 6
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
549 473 470 455 447 434 447 447 426 25 6 6 7 7 7 7 7 9 10 10 10 10 10 9 8 8
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
817 653 645 645 645 645 645 631 616 6 6 6 6 7 7 7 8 8 9 9 10 10 10 9 8 7
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
589 463 461 456 456 461 456 456 443 10 6 6 6 6 6 6 6 6 7 9 12 12 12 12 8 8
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5414 
 tracker
 SS 2022.02.02 14:46
10 10 7 7 6 6 5 5 5 5 5 5 5 5 5 5 6 10 10 11 10 11 11 11 10 9
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
12
bugs core 5463 
 tracker
 CS 2023.07.18 08:54
826 772 737 734 720 720 734 734 651 8 8 7 7 7 7 7 7 9 9 12 12 12 12 8 8 8
Support GENERATED ALWAYS identity columns and OVERRIDE clause
13
bugs core 5463 
 tracker
 SS 2023.07.18 08:54
661 529 511 511 529 529 531 531 523 29 5 5 8 8 6 8 8 8 10 10 11 11 10 8 8 7
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5674 
 tracker
 CS 2023.08.12 05:31
8 7 7 7 7 7 5 5 5 6 6 7 7 7 7 7 7 7 9 10 10 12 12 11 11 10
Allow unused Common Table Expressions
15
bugs core 5674 
 tracker
 SS 2023.08.12 05:31
8 8 6 6 6 6 6 5 5 5 5 6 6 6 6 7 7 9 9 10 9 9 9 7 7 7
Allow unused Common Table Expressions
16
bugs core 6300 
 tracker
 CS 2023.12.13 15:41
7 7 5 5 6 6 6 6 7 6 6 6 6 6 6 7 7 8 10 10 11 10 9 9 9 9
Next attachment id, next statement id and some other additions [CORE-6300]
17
bugs gh 8211 
 tracker
 SS 2024.08.11 06:18
16166 14997 14997 14997 15115 15115 15115 15115 14885 14885 15344 15344 15765 16076 15765 16076 16308 16308 15168 906 862 624 624 X X X
DATEADD truncates milliseconds for month and year deltas.
18
functional domain create 29 
 SS 2023.10.06 22:33
9 9 9 8 6 6 6 5 5 5 5 5 7 5 6 6 7 7 9 11 12 12 12 9 9 9
CREATE DOMAIN - BLOB SEGMENT SIZE
19
functional generator alter 01 
 CS 2022.02.04 18:05
815 815 789 569 534 528 528 528 528 528 528 528 524 524 505 505 524 822 859 916 1400 1400 1400 921 719 707
ALTER SEQUENCE
20
functional generator alter 01 
 SS 2022.02.04 18:05
618 548 352 349 349 352 352 353 361 364 361 361 364 364 377 383 399 548 558 582 592 726 726 592 490 469
ALTER SEQUENCE
21
functional intfunc string left 01 
 CS 2022.02.04 18:05
4333 4333 4172 4158 4158 4091 4013 3955 3901 11 11 8 8 7 6 6 7 11 11 11 11 11 10 9 9 9
LEFT function
22
functional intfunc string left 01 
 SS 2022.02.04 18:05
4042 4042 4189 3946 3946 3946 3864 3859 3845 8 5 5 6 6 6 6 7 8 11 11 12 11 11 9 8 7
LEFT function
23
functional intfunc string right 01 
 CS 2022.02.04 18:05
4243 4231 4231 4231 4110 4110 4080 3962 3925 12 12 6 6 6 6 6 7 9 10 10 13 13 9 9 9 9
RIGHT( <string>, <number> )
24
functional intfunc string right 01 
 SS 2022.02.04 18:05
4016 4016 4060 3955 3929 3929 3790 3756 3727 8 6 6 7 6 7 7 7 11 11 11 11 11 10 9 8 8
RIGHT( <string>, <number> )
25
functional intfunc string trunc 01 
 CS 2023.03.10 09:39
3971 3665 3665 3609 3587 3587 3566 3566 3614 3625 3631 3631 3750 3750 3672 3672 3750 3672 3672 906 906 906 906 839 687 664
Test for TRUNC function
26
functional intfunc string trunc 01 
 SS 2023.03.10 09:39
3439 3196 3166 3161 3161 3151 3150 3150 3125 3125 3125 3156 3125 3156 3218 3218 3234 3234 3218 845 781 728 728 728 497 483
Test for TRUNC function
27
functional replication invalid msg if target db has no replica flag 
 CS 2024.06.21 10:50
99575 99575 99575 98757 33796 33566 31886 31886 31886 32840 32850 32850 32840 34151 32839 32839 34151 51016 51781 60430 64948 64948 64948 56052 36437 36437
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
28
functional replication invalid msg if target db has no replica flag 
 SS 2024.06.21 10:50
99062 99062 98649 98518 34109 33250 29696 29696 29696 30041 33101 33101 33910 33910 33559 33559 33910 47635 48506 50987 51994 52463 52463 50987 36448 36252
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
4.0.6.3170
2024.12.02
68abd
4.0.6.3169
2024.11.28
1673f
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46 43663 42905 43507 35663 36256 36269 37909 36588 2508 2489 2498 2770 2440 3071 2619 2603 2929 2665 2560 4560 4146 4505 4114 4265 4992 4951 2706 2649 2769 2528
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46 42705 41918 43408 35271 35783 35938 36187 36553 2339 2220 2300 2363 2393 2723 2503 2578 3177 2527 2550 4254 4111 3753 4211 4369 3776 4724 2319 2570 2514 2285
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46 680 696 719 530 525 543 556 513 521 548 536 4 6 5 20 5 7 7 9 7 12 10 13 10 11 15 5 6 9 10
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46 510 454 467 344 374 372 369 360 343 373 365 7 4 19 5 8 6 6 5 9 12 7 12 9 9 12 11 13 7 9
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 718 687 774 545 505 555 618 527 528 526 530 5 18 7 17 6 7 6 5 10 12 8 8 9 10 9 8 8 8 6
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 448 471 481 386 378 385 401 389 356 352 373 7 12 24 7 6 6 5 7 15 9 11 13 12 13 13 6 8 7 6
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46 787 797 839 627 649 620 649 638 686 631 648 5 5 11 9 5 5 7 6 11 7 8 8 7 10 9 7 5 6 6
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 549 592 575 473 470 431 434 455 447 426 495 6 6 25 6 8 7 6 7 10 10 9 10 14 14 9 8 8 7 8
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 817 820 896 640 653 620 645 718 616 701 631 5 6 6 12 6 8 7 7 9 11 8 12 9 10 11 6 8 7 7
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 602 589 646 463 441 461 432 456 462 482 443 6 6 10 6 6 5 5 6 6 15 7 9 13 12 17 7 8 7 10
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5414 
 tracker
 SS 2022.02.02 14:46 10 10 11 7 5 13 5 7 6 5 5 5 5 24 5 5 5 5 6 11 10 10 13 11 10 11 11 7 7 9
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
12
bugs core 5463 
 tracker
 CS 2023.07.18 08:54 861 826 920 772 737 720 706 734 651 775 740 6 8 7 24 7 5 5 7 9 12 9 12 12 8 12 6 8 5 9
Support GENERATED ALWAYS identity columns and OVERRIDE clause
13
bugs core 5463 
 tracker
 SS 2023.07.18 08:54 667 744 661 499 510 529 511 542 531 523 531 5 5 29 5 8 8 6 6 8 13 14 10 8 11 12 8 6 7 7
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5674 
 tracker
 CS 2023.08.12 05:31 8 8 9 7 7 7 8 8 5 5 5 6 8 6 18 7 5 7 6 7 9 10 18 10 12 13 11 10 9 8
Allow unused Common Table Expressions
15
bugs core 5674 
 tracker
 SS 2023.08.12 05:31 9 12 8 5 8 4 6 6 5 6 5 4 5 6 6 6 7 6 7 10 11 9 9 12 7 12 6 7 8 7
Allow unused Common Table Expressions
16
bugs core 6300 
 tracker
 CS 2023.12.13 15:41 8 13 7 5 7 5 5 6 7 7 6 5 7 6 6 9 6 6 7 8 12 10 11 9 12 9 9 14 4 15
Next attachment id, next statement id and some other additions [CORE-6300]
17
bugs gh 8211 
 tracker
 SS 2024.08.11 06:18 16561 16166 17353 14997 14822 14974 15876 15458 15115 14517 14723 15344 14885 17409 15765 15080 16076 16308 15168 22929 22885 862 475 906 624 601 2379 X X X
DATEADD truncates milliseconds for month and year deltas.
18
functional domain create 29 
 SS 2023.10.06 22:33 6 9 11 9 5 8 10 6 6 5 5 5 8 5 7 4 7 5 6 9 7 11 17 16 12 9 9 8 8 12
CREATE DOMAIN - BLOB SEGMENT SIZE
19
functional generator alter 01 
 CS 2022.02.04 18:05 802 952 838 815 789 494 569 494 534 528 511 528 514 603 888 495 524 504 505 822 916 859 1474 1400 1428 921 707 662 719 424
ALTER SEQUENCE
20
functional generator alter 01 
 SS 2022.02.04 18:05 679 618 672 548 339 347 352 349 353 386 346 361 365 364 332 357 383 399 377 582 558 548 1047 959 592 726 490 444 469 295
ALTER SEQUENCE
21
functional intfunc string left 01 
 CS 2022.02.04 18:05 4389 4333 4339 4069 4158 4547 4172 4091 4013 3955 3901 5 8 11 22 6 5 7 5 11 12 11 11 10 8 12 9 9 10 7
LEFT function
22
functional intfunc string left 01 
 SS 2022.02.04 18:05 4106 4042 4413 3907 3935 4416 4189 3946 3864 3845 3859 5 8 4 5 6 6 7 5 8 13 11 41 11 12 9 8 6 6 7
LEFT function
23
functional intfunc string right 01 
 CS 2022.02.04 18:05 4337 4243 4207 4280 3998 4231 4241 4110 3962 4080 3925 6 12 6 16 6 6 6 9 7 10 13 13 9 14 9 5 11 9 9
RIGHT( <string>, <number> )
24
functional intfunc string right 01 
 SS 2022.02.04 18:05 4222 4016 4060 3955 3867 4065 4097 3929 3790 3727 3756 6 8 6 5 7 7 5 7 11 11 11 19 11 10 9 7 8 8 5
RIGHT( <string>, <number> )
25
functional intfunc string trunc 01 
 CS 2023.03.10 09:39 3992 4064 3971 3609 3665 3587 3722 3564 3566 3614 3470 3631 3625 3776 4730 3628 3750 3476 3672 4238 4315 854 906 839 1044 916 664 655 687 443
Test for TRUNC function
26
functional intfunc string trunc 01 
 SS 2023.03.10 09:39 3518 3439 3535 3150 3161 3196 3166 3150 3108 3151 3050 3200 3125 3042 3221 3156 3023 3234 3218 3425 3461 592 454 845 781 728 483 497 477 298
Test for TRUNC function
27
functional replication invalid msg if target db has no replica flag 
 CS 2024.06.21 10:50 99669 99355 99575 102724 98757 102196 33796 33566 31886 30037 31509 32850 32840 36184 44191 32839 32458 34151 32463 51016 51781 60430 64948 70318 73231 56052 36437 36052 35349 36653
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
28
functional replication invalid msg if target db has no replica flag 
 SS 2024.06.21 10:50 102436 99062 99155 98649 98518 99593 34109 33250 29696 26790 26866 33101 30041 36862 41456 29553 33910 30709 33559 48506 47635 51994 66759 50987 57870 52463 36448 33064 32946 36252
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5463
http://tracker.firebirdsql.org/browse/CORE-5674
http://tracker.firebirdsql.org/browse/CORE-6300
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/generator/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_trunc_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_invalid_msg_if_target_db_has_no_replica_flag.py
https://github.com/FirebirdSQL/firebird/issues/8211
=== end of list ===

Last commits information (all timestamps in UTC):