01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (21 rows)
07. Has fails: tests with at least one fail for previous 30 runs (13 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2440 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 31.03.2025 06:21
Tested: FB40.   Build / date: 4.0.6.3195-b9faf7a4 / 2025.03.28;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3195
2025.03.28
b9faf
4.0.6.3194
2025.03.26
912aa
4.0.6.3193
2025.03.20
80234
4.0.6.3192
2025.03.13
2a9da
4.0.6.3191
2025.03.10
3d9fd
4.0.6.3190
2025.02.25
c9928
4.0.6.3189
2025.02.22
3fb0b
4.0.6.3188
2025.02.21
8ee1c
4.0.6.3186
2025.02.19
92cb6
4.0.6.3185
2025.02.16
9cac4
4.0.6.3183
2025.02.04
bf738
4.0.6.3181
2025.02.01
00b64
4.0.6.3180
2025.01.27
2edb8
4.0.6.3179
2025.01.24
008d4
4.0.6.3178
2025.01.20
ec94d
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
4.0.6.3170
2024.12.02
68abd
4.0.6.3169
2024.11.28
1673f
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26
43482 16595 15559 15559 15559 15367 14731 14731 14731 13764 14659 14711 14659 14659 14659 14589 9029 9006 9006 8840 8840 8680 8680 8680 8931 8931
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26
41956 15444 14816 14816 14816 14866 14866 14866 14691 14642 13765 13645 13645 13645 13645 13645 8767 8568 8568 8523 8500 8258 8258 8258 8783 9105
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46
758 758 716 713 713 656 656 663 695 695 695 710 696 719 696 696 543 543 530 525 543 536 521 521 6 6
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46
522 485 481 480 480 480 474 474 479 480 479 479 471 467 454 454 374 372 369 369 369 365 360 343 19 7
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
653 705 712 717 717 705 677 673 673 677 711 718 718 718 718 687 555 555 545 528 528 528 527 526 18 17
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
465 500 500 527 527 527 515 527 515 515 524 524 503 481 479 471 386 386 386 385 385 373 356 352 24 12
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46
986 936 824 824 818 818 818 915 842 858 842 842 820 820 797 786 649 649 638 649 638 648 638 631 11 9
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
621 607 590 590 601 601 598 598 589 550 550 550 589 575 575 542 473 470 455 447 434 447 447 426 25 6
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
659 803 803 803 823 823 823 835 836 840 840 840 836 846 821 820 653 645 645 645 645 645 631 616 6 6
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
436 565 581 581 583 608 612 608 612 612 610 610 610 610 589 589 463 461 456 456 461 456 456 443 10 6
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5028 
 tracker
 SS 2022.02.02 14:46
366 14 8 8 8 8 8 8 8 8 8 8 8 8 8 8 6 7 7 7 5 7 6 6 6 7
Report the remote port number in MON$ATTACHMENTS
12
bugs core 5273 
 tracker
 SS 2024.05.15 17:26
2583 10 6 6 9 7 9 9 9 7 9 9 9 9 9 8 6 6 6 6 7 7 7 5 7 7
Attempt to create database with running trace leads to consistency check (cannot find tip page (165), file: tra.cpp line: 2233)
13
bugs core 5463 
 tracker
 CS 2023.07.18 08:54
772 911 911 946 911 949 978 978 961 961 921 921 921 920 920 826 772 737 734 720 720 734 734 651 8 8
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5463 
 tracker
 SS 2023.07.18 08:54
508 651 651 651 651 709 709 693 693 677 675 675 675 675 661 642 529 511 511 529 529 531 531 523 29 5
Support GENERATED ALWAYS identity columns and OVERRIDE clause
15
bugs core 6138 
 tracker
 CS 2022.02.02 14:46
678 11 7 5 7 7 7 7 7 7 7 7 10 10 10 10 6 6 6 6 6 6 6 6 6 6
Inconsistent behavior regarding visibility of master record on detail inserts
16
functional database create 11 
 CS 2022.02.04 18:05
615 12 8 7 8 9 8 7 9 7 7 8 9 8 8 8 7 6 6 5 6 5 5 6 6 6
Create database: Default char set NONE
17
functional domain create 38 
 SS 2023.10.07 07:48
468 13 8 6 8 8 8 9 9 9 9 9 7 6 6 6 5 5 5 5 5 6 6 5 6 6
CREATE DOMAIN - CHECK
18
functional intfunc string left 01 
 CS 2022.02.04 18:05
674 4157 4366 4366 4366 4366 4571 4571 4571 4571 4571 4624 4624 4624 4339 4333 4333 4172 4158 4158 4091 4013 3955 3901 11 11
LEFT function
19
functional intfunc string left 01 
 SS 2022.02.04 18:05
520 4221 4223 4223 4223 4255 4300 4118 4522 4522 4318 4141 4141 4141 4094 4042 4042 4189 3946 3946 3946 3864 3859 3845 8 5
LEFT function
20
functional intfunc string right 01 
 CS 2022.02.04 18:05
684 4371 4371 4430 4371 4371 4404 4404 4404 4404 4404 4421 4421 4244 4280 4243 4231 4231 4231 4110 4110 4080 3962 3925 12 12
RIGHT( <string>, <number> )
21
functional intfunc string right 01 
 SS 2022.02.04 18:05
439 4160 4165 4220 4220 4255 4284 4284 4284 4233 4216 4178 4114 4060 4016 3999 4016 4060 3955 3929 3929 3790 3756 3727 8 6
RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3195
2025.03.28
b9faf
4.0.6.3194
2025.03.26
912aa
4.0.6.3193
2025.03.20
80234
4.0.6.3192
2025.03.13
2a9da
4.0.6.3191
2025.03.10
3d9fd
4.0.6.3190
2025.02.25
c9928
4.0.6.3189
2025.02.22
3fb0b
4.0.6.3188
2025.02.21
8ee1c
4.0.6.3186
2025.02.19
92cb6
4.0.6.3185
2025.02.16
9cac4
4.0.6.3183
2025.02.04
bf738
4.0.6.3181
2025.02.01
00b64
4.0.6.3180
2025.01.27
2edb8
4.0.6.3179
2025.01.24
008d4
4.0.6.3178
2025.01.20
ec94d
4.0.6.3176
2025.01.16
79cc1
4.0.6.3175
2025.01.15
91361
4.0.6.3174
2024.12.23
ffd39
4.0.6.3173
2024.12.19
60b32
4.0.6.3172
2024.12.11
33f5d
4.0.6.3171
2024.12.10
ab1d4
4.0.6.3170
2024.12.02
68abd
4.0.6.3169
2024.11.28
1673f
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
Test TITLE
1
bugs core 0214 
 tracker
 CS 2025.01.18 11:26 43482 48820 45685 14913 16595 15559 15367 16526 14731 13516 13764 14848 14801 13641 14659 14711 14589 14685 9029 8766 8840 9006 9178 8525 8488 8680 9288 8931 9330 7151
Count (DISTINCT ...) is too slow
2
bugs core 0214 
 tracker
 SS 2025.01.18 11:26 41956 45985 44501 15444 14816 14606 14470 15533 14866 15341 13765 14691 14642 13275 13034 13645 14100 14272 8767 8523 8568 8500 8646 7900 8007 8258 9105 8783 11552 9222
Count (DISTINCT ...) is too slow
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46 725 914 817 713 758 716 656 648 713 635 663 710 695 749 674 730 696 719 530 525 543 556 513 521 548 536 4 6 5 20
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46 539 485 522 465 524 481 480 474 472 537 428 495 479 480 453 471 454 467 344 374 372 369 360 343 373 365 7 4 19 5
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 618 624 653 712 717 705 748 744 673 659 677 652 718 711 753 718 687 774 545 505 555 618 527 528 526 530 5 18 7 17
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 441 463 465 564 500 544 498 527 544 515 499 534 503 524 556 479 471 481 386 378 385 401 389 356 352 373 7 12 24 7
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46 986 1023 1056 824 936 809 797 915 818 1388 792 915 842 858 820 786 797 839 627 649 620 649 638 686 631 648 5 5 11 9
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 694 621 698 523 576 607 590 607 601 598 548 550 589 531 616 542 592 575 473 470 431 434 455 447 426 495 6 6 25 6
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 596 593 659 803 900 922 803 798 823 1080 835 840 836 883 846 821 820 896 640 653 620 645 718 616 701 631 5 6 6 12
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 429 436 433 565 583 581 616 554 608 631 612 595 648 610 559 638 589 646 463 441 461 432 456 462 482 443 6 6 10 6
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5028 
 tracker
 SS 2022.02.02 14:46 383 366 412 7 14 8 8 6 8 8 8 7 9 7 10 8 6 10 5 8 4 7 7 5 5 7 6 6 32 7
Report the remote port number in MON$ATTACHMENTS
12
bugs core 5273 
 tracker
 SS 2024.05.15 17:26 2641 2583 2685 6 10 6 6 9 10 7 9 9 6 6 10 10 9 8 5 6 6 7 7 5 7 5 9 5 7 7
Attempt to create database with running trace leads to consistency check (cannot find tip page (165), file: tra.cpp line: 2233)
13
bugs core 5463 
 tracker
 CS 2023.07.18 08:54 632 665 772 946 911 949 910 978 841 1624 978 884 961 890 921 993 826 920 772 737 720 706 734 651 775 740 6 8 7 24
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5463 
 tracker
 SS 2023.07.18 08:54 472 467 508 714 651 651 709 649 738 711 661 693 620 677 675 642 744 661 499 510 529 511 542 531 523 531 5 5 29 5
Support GENERATED ALWAYS identity columns and OVERRIDE clause
15
bugs core 6138 
 tracker
 CS 2022.02.02 14:46 680 678 816 5 11 7 5 5 13 17 7 7 7 10 7 10 10 11 6 6 6 6 7 5 7 4 6 6 6 6
Inconsistent behavior regarding visibility of master record on detail inserts
16
functional database create 11 
 CS 2022.02.04 18:05 668 615 701 7 6 12 8 7 9 9 6 7 12 7 8 9 13 8 7 5 6 6 5 5 6 5 6 6 6 19
Create database: Default char set NONE
17
functional domain create 38 
 SS 2023.10.07 07:48 513 468 523 6 13 8 6 6 8 16 9 9 11 7 6 9 6 6 5 5 5 5 6 5 8 8 4 5 6 6
CREATE DOMAIN - CHECK
18
functional intfunc string left 01 
 CS 2022.02.04 18:05 635 592 674 4410 4400 4157 4366 4361 4595 6840 4571 4527 4547 4698 4624 4713 4333 4339 4069 4158 4547 4172 4091 4013 3955 3901 5 8 11 22
LEFT function
19
functional intfunc string left 01 
 SS 2022.02.04 18:05 449 414 520 4221 4223 4255 4300 4118 4058 6970 4522 4092 4756 4141 4318 4094 4042 4413 3907 3935 4416 4189 3946 3864 3845 3859 5 8 4 5
LEFT function
20
functional intfunc string right 01 
 CS 2022.02.04 18:05 594 587 684 4501 4430 4371 4288 4545 4317 7249 4404 4330 4538 4244 4485 4421 4243 4207 4280 3998 4231 4241 4110 3962 4080 3925 6 12 6 16
RIGHT( <string>, <number> )
21
functional intfunc string right 01 
 SS 2022.02.04 18:05 425 434 439 4283 4220 4160 4165 4255 4359 7059 4284 4233 4178 4216 4114 3999 4016 4060 3955 3867 4065 4097 3929 3790 3727 3756 6 8 6 5
RIGHT( <string>, <number> )

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-5028
http://tracker.firebirdsql.org/browse/CORE-5273
http://tracker.firebirdsql.org/browse/CORE-5463
http://tracker.firebirdsql.org/browse/CORE-6138
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_38.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
=== end of list ===

Last commits information (all timestamps in UTC):