01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (22 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2316 rows)
10. All tests: outcomes for previous 30 runs (4746 rows)
11. All tests: durations for previous 30 runs (4690 rows)
12. Skipped: tests which was intentionally excluded from execution (136 rows)

Generated 10.06.2024 21:37
Tested: FB40.   Build: 4.0.5.3109;   SS: 10.06.24 19:42:28 - 10.06.24 20:35:05;   CS: 10.06.24 20:35:58 - 10.06.24 21:36:07;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 4.0.5.3109
2024-06-10		 4.0.5.3099
2024-05-15		 4.0.5.3098
2024-05-13		 4.0.5.3097
2024-05-09		 4.0.5.3092
2024-05-07		 4.0.5.3091
2024-05-05		 4.0.5.3089
2024-04-27		 4.0.5.3088
2024-04-19		 4.0.5.3086
2024-04-17		 4.0.5.3083
2024-04-14		 4.0.5.3082
2024-03-29		 4.0.5.3081
2024-03-24		 4.0.5.3080
2024-03-22		 4.0.5.3078
2024-03-16		 4.0.5.3077
2024-03-15		 4.0.5.3066
2024-03-13		 4.0.5.3064
2024-03-09		 4.0.5.3062
2024-03-05		 4.0.5.3061
2024-02-21		 4.0.5.3059
2024-02-18		 4.0.5.3058
2024-02-13		 4.0.5.3057
2024-02-12		 4.0.5.3056
2024-02-11		 4.0.5.3055
2024-02-09		 4.0.5.3054
2024-02-04		 4.0.5.3053
2024-01-30		 4.0.5.3052
2024-01-26		 4.0.5.3051
2024-01-24		 4.0.5.3050
2024-01-16		 4.0.5.3049
2023-12-29
Test TITLE
1
bugs core 2966 
 tracker
 CS P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
2
bugs core 2966 
 tracker
 SS P X P P P P F P P P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
3
bugs core 4236 
 tracker
 CS F P F P P P P F P P P P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
4
bugs core 4880 
 tracker
 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Better performance of creating packages containing many functions
5
bugs core 5093 
 tracker
 SS P X P P P P P P P P P P P P P P P P P P P P P P P P P F P P
Alter computed field type does not work
6
bugs core 5706 
 tracker
 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Trace config with misplaced "{" lead firebird to crash
7
bugs core 6278 
 tracker
 CS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
8
bugs core 6278 
 tracker
 SS P X P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
9
bugs gh 4723 incompressible 
 tracker
 CS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
10
bugs gh 4723 incompressible 
 tracker
 SS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
11
bugs gh 6875 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12
bugs gh 6875 
 tracker
 SS P X P P P P P F P P P P P P P P P P P P P F F P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
13
bugs gh 7139 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P
With multiple trace sessions user may receive trace events related to engine's requests
14
bugs gh 7200 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
15
bugs gh 7200 
 tracker
 SS P X P P P P P P P P P P P P P P P P P P F P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
16
bugs gh 7818 
 tracker
 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
17
bugs gh 7818 
 tracker
 SS P X P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
18
bugs gh 7854 
 tracker
 SS P X P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Performance issue with time zones
19
bugs gh 8066 
 tracker
 CS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
20
bugs gh 8066 
 tracker
 SS P X P P F X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
21
functional replication bugcheck in rw replica after conflicting insert 
 CS P P P P P P P P P P P F F P P X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
22
functional replication bugcheck in rw replica after conflicting insert 
 SS P X P P P P P P P P P F F P P X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3109
2024-06-10		 4.0.5.3099
2024-05-15		 4.0.5.3098
2024-05-13		 4.0.5.3097
2024-05-09		 4.0.5.3092
2024-05-07		 4.0.5.3091
2024-05-05		 4.0.5.3089
2024-04-27		 4.0.5.3088
2024-04-19		 4.0.5.3086
2024-04-17		 4.0.5.3083
2024-04-14		 4.0.5.3082
2024-03-29		 4.0.5.3081
2024-03-24		 4.0.5.3080
2024-03-22		 4.0.5.3078
2024-03-16		 4.0.5.3077
2024-03-15		 4.0.5.3066
2024-03-13		 4.0.5.3064
2024-03-09		 4.0.5.3062
2024-03-05		 4.0.5.3061
2024-02-21		 4.0.5.3059
2024-02-18		 4.0.5.3058
2024-02-13		 4.0.5.3057
2024-02-12		 4.0.5.3056
2024-02-11		 4.0.5.3055
2024-02-09		 4.0.5.3054
2024-02-04		 4.0.5.3053
2024-01-30		 4.0.5.3052
2024-01-26		 4.0.5.3051
2024-01-24		 4.0.5.3050
2024-01-16		 4.0.5.3049
2023-12-29
Test TITLE
1
bugs core 2966 
 tracker
 CS 47538 45132 59326 50608 45234 47296 47624 27357 47660 45627 44505 47453 44935 45329 47229 44819 50083 43022 43473 46815 47662 54420 52797 51942 48670 50562 50998 50115 49313 46340 53510
Wrong results or unexpected errors while sorting a large data set
2
bugs core 2966 
 tracker
 SS 43245 41520 0 45661 40449 43245 43422 33799 42839 41380 40755 42792 42620 43469 43553 40926 47407 39324 39482 42531 43167 49573 47447 47111 43358 47483 47041 46326 43197 43480 46079
Wrong results or unexpected errors while sorting a large data set
3
bugs core 4236 
 tracker
 CS 11474 11393 11616 13321 11393 11350 11466 11231 11311 11382 11343 11449 11627 11349 11436 11493 11483 11283 11367 11540 11507 11727 11769 11626 11618 11513 11385 11688 11898 11553 11424
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
4
bugs core 4880 
 tracker
 CS 187821 226443 160219 136619 175989 199875 189475 175540 175174 176500 163979 186167 168131 174392 175324 179619 180816 165086 159840 226665 217444 240551 243456 243356 246622 216182 216615 216193 223498 217985 221653
Better performance of creating packages containing many functions
5
bugs core 5093 
 tracker
 SS 546 641 0 480 469 546 541 539 526 476 516 534 546 500 542 530 504 539 525 668 593 627 667 642 670 615 589 615 620 749 609
Alter computed field type does not work
6
bugs core 5706 
 tracker
 CS 2897 2894 3126 2870 2909 2906 2855 2860 2865 2865 2853 2876 2862 2892 2846 2871 2875 2581 2859 3007 2954 3025 2947 2931 2963 2901 2967 2951 2960 3150 2910
Trace config with misplaced "{" lead firebird to crash
7
bugs core 6278 
 tracker
 CS 2822 560 745 568 491 2581 2847 2540 2571 2825 2797 2810 2560 2815 2842 2819 2844 2775 2530 2910 2860 2916 2966 2912 2903 2816 2917 2866 2877 3073 2874
Efficient table scans for DBKEY-based range conditions
8
bugs core 6278 
 tracker
 SS 2433 313 0 294 362 2409 2426 2430 2442 2416 2427 2409 2433 2426 2423 2434 2433 2410 2433 2461 2449 2715 2519 2456 2495 2512 2468 2478 2453 2577 2496
Efficient table scans for DBKEY-based range conditions
9
bugs gh 4723 incompressible 
 tracker
 CS 2069 2069 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
10
bugs gh 4723 incompressible 
 tracker
 SS 1995 1995 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
11
bugs gh 6875 
 tracker
 CS 4210 3746 4665 3872 3926 4772 3990 3640 3779 3795 3531 4195 3885 3762 3710 3764 4225 3730 3665 4292 4789 5863 5552 6469 6279 4708 5729 4576 4666 5212 4402
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12
bugs gh 6875 
 tracker
 SS 3817 3516 0 3527 4096 4508 3817 3623 3713 3621 3432 3685 3506 3606 3514 3350 3800 3587 3686 4283 4302 4924 4952 6507 4766 4541 4530 4378 4525 4866 4428
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
13
bugs gh 7139 
 tracker
 CS 5107 5139 5433 5094 5059 5121 5207 5048 5068 5035 5053 5044 5008 5067 5036 5069 5092 5080 5042 5160 5466 5190 5451 5512 5441 4027 5431 5160 5493 5342 5225
With multiple trace sessions user may receive trace events related to engine's requests
14
bugs gh 7200 
 tracker
 CS 5205 4925 6008 5041 5001 5192 5118 4799 4872 4757 4653 5175 4653 5124 4781 5219 5236 4760 4756 5728 5707 6450 5647 6126 6391 5686 5712 5469 6272 6192 6376
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
15
bugs gh 7200 
 tracker
 SS 5457 5522 0 5500 5701 5706 6209 5422 5457 5527 4253 5507 5241 4534 4315 4660 5586 4339 4352 6053 4829 6481 5302 6772 5406 4833 6040 5805 5328 6122 5333
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
16
bugs gh 7818 
 tracker
 CS 348 370 527 329 298 326 322 300 326 328 328 359 290 305 323 363 317 257 320 360 363 420 371 390 453 361 422 345 368 520 351
Extend rdb$get_context('SYSTEM', '***') with client-related info
17
bugs gh 7818 
 tracker
 SS 210 188 0 200 197 181 225 173 188 211 185 193 164 189 186 180 225 179 171 228 210 291 252 250 274 270 276 210 272 344 252
Extend rdb$get_context('SYSTEM', '***') with client-related info
18
bugs gh 7854 
 tracker
 SS 3843 3077 0 3086 3843 3922 3857 3691 3344 3558 3522 3761 3625 3782 3755 3841 3652 3493 3660 4428 4603 5641 5613 5972 5482 4188 4532 4643 4922 5208 4404
Performance issue with time zones
19
bugs gh 8066 
 tracker
 CS 698 698 912 659 655 1122 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
20
bugs gh 8066 
 tracker
 SS 534 587 0 481 442 777 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
21
functional replication bugcheck in rw replica after conflicting insert 
 CS 6627 6662 6627 6501 6443 6671 6569 6584 6873 6528 6503 6461 69211 68993 13598 13825 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
22
functional replication bugcheck in rw replica after conflicting insert 
 SS 6178 6285 0 6140 6147 6170 6208 6168 6123 6146 6118 6186 68767 69367 13237 13322 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5093
http://tracker.firebirdsql.org/browse/core-5706
http://tracker.firebirdsql.org/browse/core-6278
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7139
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/7854
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===