01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (21 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2386 rows)
11. All tests: durations for previous 30 runs (4605 rows)
12. Skipped: tests which was intentionally excluded from execution (70 rows)

Generated 12.05.2024 13:10
Tested: FB40.   Build: 4.0.5.3098;   SS: 12.05.24 11:23:51 - 12.05.24 12:11:23;   CS: 12.05.24 12:12:17 - 12.05.24 13:08:48;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 4.0.5.3098
2024-05-12		 4.0.5.3097
2024-05-09		 4.0.5.3092
2024-05-07		 4.0.5.3091
2024-05-05		 4.0.5.3089
2024-04-27		 4.0.5.3088
2024-04-19		 4.0.5.3086
2024-04-17		 4.0.5.3083
2024-04-14		 4.0.5.3082
2024-03-29		 4.0.5.3081
2024-03-24		 4.0.5.3080
2024-03-22		 4.0.5.3078
2024-03-16		 4.0.5.3077
2024-03-15		 4.0.5.3066
2024-03-13		 4.0.5.3064
2024-03-09		 4.0.5.3062
2024-03-05		 4.0.5.3061
2024-02-21		 4.0.5.3059
2024-02-18		 4.0.5.3058
2024-02-13		 4.0.5.3057
2024-02-12		 4.0.5.3056
2024-02-11		 4.0.5.3055
2024-02-09		 4.0.5.3054
2024-02-04		 4.0.5.3053
2024-01-30		 4.0.5.3052
2024-01-26		 4.0.5.3051
2024-01-24		 4.0.5.3050
2024-01-16		 4.0.5.3049
2023-12-29		 4.0.5.3042
2023-12-20		 4.0.5.3041
2023-12-19
Test TITLE
1
bugs core 2966 
 tracker
 CS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
2
bugs core 2966 
 tracker
 SS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
3
bugs core 4236 
 tracker
 CS F P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
4
bugs core 4880 
 tracker
 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Better performance of creating packages containing many functions
5
bugs core 5093 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
Alter computed field type does not work
6
bugs core 5210 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
7
bugs core 6278 
 tracker
 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
8
bugs core 6278 
 tracker
 SS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
9
bugs gh 6875 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
10
bugs gh 6875 
 tracker
 SS F P P P P F P P P P P P P P P P P P P F F P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7139 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P
With multiple trace sessions user may receive trace events related to engine's requests
12
bugs gh 7200 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13
bugs gh 7200 
 tracker
 SS F P P P P P P P P P P P P P P P P P F P P P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
14
bugs gh 7818 
 tracker
 CS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
15
bugs gh 7818 
 tracker
 SS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
16
bugs gh 7854 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
Performance issue with time zones
17
bugs gh 8066 
 tracker
 CS P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
18
bugs gh 8066 
 tracker
 SS P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
19
functional replication bugcheck in rw replica after conflicting insert 
 CS P P P P P P P P P F F P P X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
20
functional replication bugcheck in rw replica after conflicting insert 
 SS P P P P P P P P P F F P P X X X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
21
functional syspriv trace any attachment 
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Check ability to trace any attachment by non-sysdba user who is granted with necessary system privileges

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3098
2024-05-12		 4.0.5.3097
2024-05-09		 4.0.5.3092
2024-05-07		 4.0.5.3091
2024-05-05		 4.0.5.3089
2024-04-27		 4.0.5.3088
2024-04-19		 4.0.5.3086
2024-04-17		 4.0.5.3083
2024-04-14		 4.0.5.3082
2024-03-29		 4.0.5.3081
2024-03-24		 4.0.5.3080
2024-03-22		 4.0.5.3078
2024-03-16		 4.0.5.3077
2024-03-15		 4.0.5.3066
2024-03-13		 4.0.5.3064
2024-03-09		 4.0.5.3062
2024-03-05		 4.0.5.3061
2024-02-21		 4.0.5.3059
2024-02-18		 4.0.5.3058
2024-02-13		 4.0.5.3057
2024-02-12		 4.0.5.3056
2024-02-11		 4.0.5.3055
2024-02-09		 4.0.5.3054
2024-02-04		 4.0.5.3053
2024-01-30		 4.0.5.3052
2024-01-26		 4.0.5.3051
2024-01-24		 4.0.5.3050
2024-01-16		 4.0.5.3049
2023-12-29		 4.0.5.3042
2023-12-20		 4.0.5.3041
2023-12-19
Test TITLE
1
bugs core 2966 
 tracker
 CS 47642 50142 45234 47296 47624 27357 47660 45627 44505 47453 44935 45329 47229 44819 50083 43022 43473 46815 47662 54420 52797 51942 48670 50562 50998 50115 49313 46340 53510 53581 51249
Wrong results or unexpected errors while sorting a large data set
2
bugs core 2966 
 tracker
 SS 43390 44405 40449 43245 43422 33799 42839 41380 40755 42792 42620 43469 43553 40926 47407 39324 39482 42531 43167 49573 47447 47111 43358 47483 47041 46326 43197 43480 46079 48066 47401
Wrong results or unexpected errors while sorting a large data set
3
bugs core 4236 
 tracker
 CS 11474 13797 11393 11350 11466 11231 11311 11382 11343 11449 11627 11349 11436 11493 11483 11283 11367 11540 11507 11727 11769 11626 11618 11513 11385 11688 11898 11553 11424 11600 11287
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
4
bugs core 4880 
 tracker
 CS 194675 146147 175989 199875 189475 175540 175174 176500 163979 186167 168131 174392 175324 179619 180816 165086 159840 226665 217444 240551 243456 243356 246622 216182 216615 216193 223498 217985 221653 233068 225290
Better performance of creating packages containing many functions
5
bugs core 5093 
 tracker
 SS 546 518 469 546 541 539 526 476 516 534 546 500 542 530 504 539 525 668 593 627 667 642 670 615 589 615 620 749 609 706 685
Alter computed field type does not work
6
bugs core 5210 
 tracker
 CS 5863 5857 5819 5803 5826 5827 5791 5803 5789 5870 5818 5816 5843 5849 5895 5841 5805 5986 5952 6076 6168 6093 6129 5977 6014 5958 6081 6239 6055 1544 5998
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
7
bugs core 6278 
 tracker
 CS 2843 483 491 2581 2847 2540 2571 2825 2797 2810 2560 2815 2842 2819 2844 2775 2530 2910 2860 2916 2966 2912 2903 2816 2917 2866 2877 3073 2874 2900 2891
Efficient table scans for DBKEY-based range conditions
8
bugs core 6278 
 tracker
 SS 2438 356 362 2409 2426 2430 2442 2416 2427 2409 2433 2426 2423 2434 2433 2410 2433 2461 2449 2715 2519 2456 2495 2512 2468 2478 2453 2577 2496 2513 2474
Efficient table scans for DBKEY-based range conditions
9
bugs gh 6875 
 tracker
 CS 4258 3852 3926 4772 3990 3640 3779 3795 3531 4195 3885 3762 3710 3764 4225 3730 3665 4292 4789 5863 5552 6469 6279 4708 5729 4576 4666 5212 4402 5012 4371
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
10
bugs gh 6875 
 tracker
 SS 4191 4100 4096 4508 3817 3623 3713 3621 3432 3685 3506 3606 3514 3350 3800 3587 3686 4283 4302 4924 4952 6507 4766 4541 4530 4378 4525 4866 4428 5291 4322
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7139 
 tracker
 CS 5106 5086 5059 5121 5207 5048 5068 5035 5053 5044 5008 5067 5036 5069 5092 5080 5042 5160 5466 5190 5451 5512 5441 4027 5431 5160 5493 5342 5225 5172 5399
With multiple trace sessions user may receive trace events related to engine's requests
12
bugs gh 7200 
 tracker
 CS 5227 5049 5001 5192 5118 4799 4872 4757 4653 5175 4653 5124 4781 5219 5236 4760 4756 5728 5707 6450 5647 6126 6391 5686 5712 5469 6272 6192 6376 6387 6064
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13
bugs gh 7200 
 tracker
 SS 5439 6321 5701 5706 6209 5422 5457 5527 4253 5507 5241 4534 4315 4660 5586 4339 4352 6053 4829 6481 5302 6772 5406 4833 6040 5805 5328 6122 5333 7053 4877
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
14
bugs gh 7818 
 tracker
 CS 348 314 298 326 322 300 326 328 328 359 290 305 323 363 317 257 320 360 363 420 371 390 453 361 422 345 368 520 351 418 368
Extend rdb$get_context('SYSTEM', '***') with client-related info
15
bugs gh 7818 
 tracker
 SS 210 190 197 181 225 173 188 211 185 193 164 189 186 180 225 179 171 228 210 291 252 250 274 270 276 210 272 344 252 255 242
Extend rdb$get_context('SYSTEM', '***') with client-related info
16
bugs gh 7854 
 tracker
 SS 3889 3057 3843 3922 3857 3691 3344 3558 3522 3761 3625 3782 3755 3841 3652 3493 3660 4428 4603 5641 5613 5972 5482 4188 4532 4643 4922 5208 4404 5338 4957
Performance issue with time zones
17
bugs gh 8066 
 tracker
 CS 655 629 655 1122 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
18
bugs gh 8066 
 tracker
 SS 504 504 442 777 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
19
functional replication bugcheck in rw replica after conflicting insert 
 CS 6638 6638 6443 6671 6569 6584 6873 6528 6503 6461 69211 68993 13598 13825 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
20
functional replication bugcheck in rw replica after conflicting insert 
 SS 6186 6382 6147 6170 6208 6168 6123 6146 6118 6186 68767 69367 13237 13322 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
21
functional syspriv trace any attachment 
 CS 4225 4248 4005 4238 4181 4129 4003 4109 3949 4180 3921 3954 4061 4098 4122 3936 4080 4413 4462 4886 4744 5018 5024 4495 4451 4295 4614 4695 4493 4875 4213
Check ability to trace any attachment by non-sysdba user who is granted with necessary system privileges

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5093
http://tracker.firebirdsql.org/browse/core-5210
http://tracker.firebirdsql.org/browse/core-6278
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_trace_any_attachment.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7139
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/7854
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===