01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (16 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
10. All tests: outcomes for previous 30 runs (4916 rows)
11. All tests: durations for previous 30 runs (4845 rows)
12. Skipped: tests which was intentionally excluded from execution (144 rows)

Generated 15.05.2024 05:29
Tested: FB50.   Build: 5.0.1.1399;   CS: 15.05.24 04:01:52 - 15.05.24 05:27:33;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 5.0.1.1399
2024-05-15		 5.0.1.1398
2024-05-14		 5.0.1.1397
2024-05-09		 5.0.1.1395
2024-05-08		 5.0.1.1394
2024-05-06		 5.0.1.1393
2024-05-02		 5.0.1.1392
2024-04-30		 5.0.1.1391
2024-04-29		 5.0.1.1390
2024-04-27		 5.0.1.1389
2024-04-26		 5.0.1.1387
2024-04-25		 5.0.1.1386
2024-04-21		 5.0.1.1383
2024-04-19		 5.0.1.1381
2024-04-17		 5.0.1.1379
2024-04-14		 5.0.1.1378
2024-04-10		 5.0.1.1377
2024-04-04		 5.0.1.1373
2024-04-01		 5.0.1.1372
2024-03-29		 5.0.1.1371
2024-03-24		 5.0.1.1370
2024-03-22		 5.0.1.1369
2024-03-17		 5.0.1.1368
2024-03-16		 5.0.1.1363
2024-03-15		 5.0.1.1360
2024-03-14		 5.0.1.1358
2024-03-13		 5.0.1.1348
2024-03-09		 5.0.1.1347
2024-03-05		 5.0.1.1344
2024-02-21		 5.0.1.1342
2024-02-19
Test TITLE
1
bugs core 0733 
 tracker
 SS X F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2
bugs core 2966 
 tracker
 CS P P P P P P P P F F P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
3
bugs core 2966 
 tracker
 SS X P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
4
bugs core 3323 
 tracker
 CS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
5
bugs core 4236 
 tracker
 CS P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
6
bugs core 5087 
 tracker
 CS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
7
bugs core 5602 
 tracker
 CS P P P P P P P P P P P P P P P P P F F F F F F F F F F P P P
Slow changes on domain
8
bugs core 5602 
 tracker
 SS X P P P P P P P P P P P P P P P P F F F F F F F F F F P P P
Slow changes on domain
9
bugs core 5995 
 tracker
 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Creator user name is empty in user trace sessions
10
bugs gh 7818 
 tracker
 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
11
bugs gh 7818 
 tracker
 SS X P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
12
bugs gh 8066 
 tracker
 CS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
13
bugs gh 8066 
 tracker
 SS X P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
14
functional replication bugcheck in rw replica after conflicting insert 
 CS P P P P P P P P P P P P P P P P P P P F F F P P X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
15
functional replication bugcheck in rw replica after conflicting insert 
 SS X P P P P P P P P P P P P P P P P P P F F F P P X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
16
functional services user management 
 CS P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
Check ability to make connect to FB services and add/drop user

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1399
2024-05-15		 5.0.1.1398
2024-05-14		 5.0.1.1397
2024-05-09		 5.0.1.1395
2024-05-08		 5.0.1.1394
2024-05-06		 5.0.1.1393
2024-05-02		 5.0.1.1392
2024-04-30		 5.0.1.1391
2024-04-29		 5.0.1.1390
2024-04-27		 5.0.1.1389
2024-04-26		 5.0.1.1387
2024-04-25		 5.0.1.1386
2024-04-21		 5.0.1.1383
2024-04-19		 5.0.1.1381
2024-04-17		 5.0.1.1379
2024-04-14		 5.0.1.1378
2024-04-10		 5.0.1.1377
2024-04-04		 5.0.1.1373
2024-04-01		 5.0.1.1372
2024-03-29		 5.0.1.1371
2024-03-24		 5.0.1.1370
2024-03-22		 5.0.1.1369
2024-03-17		 5.0.1.1368
2024-03-16		 5.0.1.1363
2024-03-15		 5.0.1.1360
2024-03-14		 5.0.1.1358
2024-03-13		 5.0.1.1348
2024-03-09		 5.0.1.1347
2024-03-05		 5.0.1.1344
2024-02-21		 5.0.1.1342
2024-02-19
Test TITLE
1
bugs core 0733 
 tracker
 SS 34006 0 30566 33061 33611 37705 36201 34926 35060 55239 33021 34569 31932 32787 38643 32295 31142 34027 34336 34006 32680 33824 33586 34013 34473 33084 34011 31868 32440 37721 40006
Compress Data over the Network
2
bugs core 2966 
 tracker
 CS 43952 93813 43361 49549 48845 44459 38705 42467 43305 21720 30862 40337 38952 41294 52499 47048 47797 40998 50176 40776 39383 48304 50423 43445 53256 41703 43316 49587 48709 51916 53331
Wrong results or unexpected errors while sorting a large data set
3
bugs core 2966 
 tracker
 SS 43512 0 38601 43512 45771 39705 36003 36753 37596 30426 36541 36354 35608 37507 74171 44108 43660 37342 71665 36027 35161 43765 63466 56569 46547 36942 59092 44639 45141 46634 48813
Wrong results or unexpected errors while sorting a large data set
4
bugs core 3323 
 tracker
 CS 7420 16221 11032 7314 8097 7994 7195 7105 8117 7506 7618 7340 7041 7241 7897 7250 7166 8638 7278 8017 6925 7054 7343 7249 9093 7577 7498 6982 7085 11085 12357
Ability to cancel waiting in lock manager
5
bugs core 4236 
 tracker
 CS 11559 11978 11453 11364 11446 11627 11495 11581 11588 12802 11518 11360 11301 11370 11450 11438 11386 11624 11449 11579 11312 11570 11565 11560 11758 11559 11660 11583 11514 11833 11853
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
6
bugs core 5087 
 tracker
 CS 18569 19601 19466 18541 18526 18461 18525 18783 18580 20384 18707 18451 18387 18557 18558 18519 18536 18455 18438 18581 18663 18527 18592 18398 18543 18585 18641 18693 18797 19432 18748
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
7
bugs core 5602 
 tracker
 CS 7364 6925 6923 6856 7220 7343 6623 7392 7206 10518 7414 7030 6713 7260 7022 7096 6871 7386 8983 9834 8929 9084 10507 10666 10876 10549 11289 10762 6620 7092 7497
Slow changes on domain
8
bugs core 5602 
 tracker
 SS 6799 0 6904 6634 6779 6844 6474 6497 6694 9382 6387 6433 6359 6799 6648 6299 6262 6825 8890 9078 8420 8441 10370 10252 10207 14003 10115 13824 6285 6653 6798
Slow changes on domain
9
bugs core 5995 
 tracker
 CS 2599 2914 2874 2594 2591 2621 2646 2627 2601 2597 2594 2620 2566 2569 2616 2589 2568 2629 2583 2603 2589 2606 2591 2604 2574 2582 2606 2569 2576 2703 2653
Creator user name is empty in user trace sessions
10
bugs gh 7818 
 tracker
 CS 357 750 592 378 370 400 341 400 361 325 326 354 326 367 370 330 306 341 340 390 340 335 334 368 399 349 409 335 336 428 447
Extend rdb$get_context('SYSTEM', '***') with client-related info
11
bugs gh 7818 
 tracker
 SS 168 0 321 168 162 183 173 172 159 243 179 140 154 164 171 153 175 163 157 169 143 171 201 161 155 171 160 133 134 251 235
Extend rdb$get_context('SYSTEM', '***') with client-related info
12
bugs gh 8066 
 tracker
 CS 982 1010 954 690 1212 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
13
bugs gh 8066 
 tracker
 SS 536 0 536 430 754 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
14
functional replication bugcheck in rw replica after conflicting insert 
 CS 6701 6819 6689 6716 6739 6801 6638 6759 6681 6181 6678 6603 6616 5703 6605 6643 6629 6754 6638 6713 70064 69162 69242 13777 13727 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
15
functional replication bugcheck in rw replica after conflicting insert 
 SS 6188 0 6141 7022 5997 7105 6016 7164 6027 5805 6013 5973 7038 7083 6116 7004 6188 6087 6061 6065 68456 69609 68495 13166 13247 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
16
functional services user management 
 CS 846 1154 1135 850 810 878 871 845 829 1501 867 852 741 799 807 791 780 804 846 868 883 803 846 836 823 849 870 774 766 916 964
Check ability to make connect to FB services and add/drop user

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5995
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_user_management.py
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===