01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (17 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (24 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2434 rows)
12. Skipped: tests which was intentionally excluded from execution (72 rows)

Generated UTC 21.11.2024 04:23
Tested: FB40.   Build / date: 4.0.6.3168-f67e22f8 / 2024.11.07;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
4.0.5.3123
2024.06.24
c27c6
4.0.5.3112
2024.06.13
d2e61
4.0.5.3098
2024.05.09
4c3ec
Test TITLE
1
bugs core 2987 
 tracker
 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Don't send full length of field over the wire when field is null
2
bugs core 4236 
 tracker
 CS P P P P P P P P P P P P F P F P P P P P P F P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
3
bugs core 5210 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
4
bugs core 5210 
 tracker
 SS P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
5
bugs core 5488 running sttm 
 tracker
 CS P P P P P P P P P P P P P F P P F P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
6
bugs core 5854 
 tracker
 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P
Very poor "similar to" performance
7
bugs gh 4723 incompressible 
 tracker
 CS X X X X X X X X X X X X X X X X X X X X X X X X X X X X F X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8
bugs gh 4723 incompressible 
 tracker
 SS X X X X X X X X X X X X X X X X X X X X X X X X X X X X F X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
9
bugs gh 6282 
 tracker
 CS P P P P P P P P P P P P P P P F F F F F F F F F F F X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10
bugs gh 6282 
 tracker
 SS P P P P P P P P P P P P P P P F F F F F F F F F F F X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
11
bugs gh 6785 
 tracker
 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
12
bugs gh 6785 
 tracker
 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
13
bugs gh 6875 
 tracker
 CS P P P P P P P P P P P F F F F P F F P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
14
bugs gh 6875 
 tracker
 SS P P P P P F P P F P P F P F P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
15
bugs gh 7188 
 tracker
 CS P P P P P P P P P F P P P P P P P P P P P P P P P P X X X X
Memory leak in GDS32.DLL(FBClient.DLL), when multi-database transaction has done
16
bugs gh 7188 
 tracker
 SS P P P P P P P P P P P P F P P P P P P P P P P P P P X X X X
Memory leak in GDS32.DLL(FBClient.DLL), when multi-database transaction has done
17
bugs gh 7200 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
18
bugs gh 7767 
 tracker
 SS P P P P P P P P P P P P P P F P P P P X X X X X X X X X X X
Slow drop trigger command execution under FB5.0
19
bugs gh 8187 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P F X X X X X X X X
Performance regression in generating of UUID values after introducing GUID-v7
20
bugs gh 8187 
 tracker
 SS P P P P P P P P P P P P P P F P P P P P P F X X X X X X X X
Performance regression in generating of UUID values after introducing GUID-v7
21
functional intfunc encryption rsa family 
 CS P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P
Basic test for RSA-family: rsa_private(), rsa_public(), rsa_encrypt(), rsa_decrypt(), rsa_sign_hash() and rsa_verify_hash()
22
functional intl non ascii firebird and trace utf8 
 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
23
functional intl non ascii firebird and trace utf8 
 SS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
24
functional session ext conn pool 01 
 CS P P P P P P P P P P P P P P P F P F P P P P P P P P P P P P
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
4.0.5.3123
2024.06.24
c27c6
4.0.5.3112
2024.06.13
d2e61
4.0.5.3098
2024.05.09
4c3ec
Test TITLE
1
bugs core 2987 
 tracker
 SS 2438 2422 2414 2414 2450 2405 2691 2420 2432 2445 2483 2424 2670 2696 2665 2729 2676 2637 2802 2606 2504 2530 2395 2351 2396 2401 2398 2425 2340 2369 2480
Don't send full length of field over the wire when field is null
2
bugs core 4236 
 tracker
 CS 537 500 518 486 538 515 602 545 515 536 559 534 845 865 854 808 924 1461 1032 628 611 659 446 497 424 456 423 425 419 488 598
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
3
bugs core 5210 
 tracker
 CS 594 572 520 529 606 587 645 793 601 570 573 566 987 1009 965 933 906 890 1021 717 718 722 506 497 458 495 466 470 541 435 624
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
4
bugs core 5210 
 tracker
 SS 390 388 379 413 386 377 602 389 409 391 364 386 620 630 617 595 630 607 719 542 564 495 338 388 357 306 373 328 383 329 465
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
5
bugs core 5488 running sttm 
 tracker
 CS 5734 5713 5700 5736 5702 5681 5694 6128 5698 5733 5741 5825 6032 6087 6624 5994 6029 7653 6096 5856 5844 5849 5593 5591 5616 5604 5645 5620 5602 5586 5854
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
6
bugs core 5854 
 tracker
 CS 970 891 863 879 851 894 933 1444 887 1054 920 925 1396 1346 1482 1931 2055 2414 1730 1181 1156 1142 958 907 919 982 1002 943 928 909 1030
Very poor "similar to" performance
7
bugs gh 4723 incompressible 
 tracker
 CS 2148 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2148 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8
bugs gh 4723 incompressible 
 tracker
 SS 1387 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1387 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
9
bugs gh 6282 
 tracker
 CS 1217 717 716 696 747 782 773 1272 716 808 786 755 1149 1176 1168 1696 1618 1258 24164 15708 40580 41591 39053 39286 40306 40129 41245 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10
bugs gh 6282 
 tracker
 SS 817 514 541 514 533 527 586 559 541 520 560 591 842 751 871 1431 1858 792 24474 16405 38814 40815 39240 38631 40612 39257 41070 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
11
bugs gh 6785 
 tracker
 CS 565 507 520 571 553 575 603 1112 535 550 550 559 797 903 1364 882 1372 1401 1024 687 644 644 402 397 471 484 471 497 433 465 617
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
12
bugs gh 6785 
 tracker
 SS 378 406 333 377 379 353 390 364 406 368 337 376 573 588 784 1103 585 580 639 476 546 521 288 290 337 352 297 300 333 325 420
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
13
bugs gh 6875 
 tracker
 CS 715 650 639 654 748 676 696 1150 761 686 734 682 981 1111 1079 1122 1108 1036 1218 843 882 872 607 610 619 623 667 596 594 582 781
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
14
bugs gh 6875 
 tracker
 SS 437 428 410 411 439 400 475 441 432 418 436 442 720 686 684 999 684 719 729 605 565 608 410 389 398 381 409 387 342 398 456
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
15
bugs gh 7188 
 tracker
 CS 5466 5186 5177 5108 5500 5143 5406 6917 4931 5453 5792 5665 7291 7741 12277 10305 10922 11451 9026 5366 5479 5573 5071 5036 4963 5114 4797 0 0 0 0
Memory leak in GDS32.DLL(FBClient.DLL), when multi-database transaction has done
16
bugs gh 7188 
 tracker
 SS 5640 5648 5632 5506 4947 4597 5880 5729 5608 6164 5922 4486 7631 7602 7992 9975 7169 7455 8967 5069 6271 5198 5532 4600 5624 4648 4780 0 0 0 0
Memory leak in GDS32.DLL(FBClient.DLL), when multi-database transaction has done
17
bugs gh 7200 
 tracker
 SS 2685 2663 2646 2691 2647 2618 2739 2679 2673 2726 2674 2731 2889 2993 3060 3450 3021 2955 3035 2835 2749 2733 2651 2583 2584 2658 2610 2628 2630 2637 2708
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
18
bugs gh 7767 
 tracker
 SS 807 684 687 751 789 696 860 791 739 807 806 742 1253 1153 1501 3307 1197 1223 1398 937 0 0 0 0 0 0 0 0 0 0 0
Slow drop trigger command execution under FB5.0
19
bugs gh 8187 
 tracker
 CS 643 505 489 497 530 524 520 601 502 531 541 598 835 888 999 868 1217 839 924 686 2563 2586 2609 0 0 0 0 0 0 0 0
Performance regression in generating of UUID values after introducing GUID-v7
20
bugs gh 8187 
 tracker
 SS 458 358 378 383 352 347 352 364 329 363 411 363 589 628 586 1685 644 576 593 505 2367 2332 2432 0 0 0 0 0 0 0 0
Performance regression in generating of UUID values after introducing GUID-v7
21
functional intfunc encryption rsa family 
 CS 740 718 701 679 722 710 740 1219 740 749 724 784 1105 1088 1644 1215 1151 1160 1166 869 872 839 692 626 700 596 636 669 663 609 745
Basic test for RSA-family: rsa_private(), rsa_public(), rsa_encrypt(), rsa_decrypt(), rsa_sign_hash() and rsa_verify_hash()
22
functional intl non ascii firebird and trace utf8 
 CS 533 483 504 442 545 558 556 926 533 505 518 513 829 876 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
23
functional intl non ascii firebird and trace utf8 
 SS 359 359 357 350 352 336 403 334 344 368 374 389 582 564 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
24
functional session ext conn pool 01 
 CS 561 516 501 506 516 545 603 926 550 592 554 568 855 858 775 866 844 886 937 687 640 709 415 455 396 433 443 439 449 427 590
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2987
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-5210
http://tracker.firebirdsql.org/browse/core-5488
http://tracker.firebirdsql.org/browse/core-5854
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/encryption/test_rsa_family.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intl/test_non_ascii_firebird_and_trace_utf8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/6282
https://github.com/FirebirdSQL/firebird/issues/6785
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7188
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7767
https://github.com/FirebirdSQL/firebird/issues/8187
=== end of list ===

Last commits information (all timestamps in UTC):