01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (18 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (4930 rows)
11. All tests: durations for previous 30 runs (4873 rows)
12. Skipped: tests which was intentionally excluded from execution (144 rows)

Generated 10.06.2024 19:40
Tested: FB50.   Build: 5.0.1.1415;   SS: 10.06.24 17:43:39 - 10.06.24 18:34:07;   CS: 10.06.24 18:35:05 - 10.06.24 19:39:15;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 5.0.1.1415
2024-06-10
5.0.1.1412
2024-06-09
5.0.1.1399
2024-05-15
5.0.1.1398
2024-05-14
5.0.1.1397
2024-05-09
5.0.1.1395
2024-05-08
5.0.1.1394
2024-05-06
5.0.1.1393
2024-05-02
5.0.1.1392
2024-04-30
5.0.1.1391
2024-04-29
5.0.1.1390
2024-04-27
5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-14
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1373
2024-04-01
5.0.1.1372
2024-03-29
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
Test TITLE
1 SS P P X F P P P P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2 CS P P P P P P P P P P F F P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
3 SS P P X P P P P P P P F P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
4 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
5 CS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
6 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
7 CS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
8 SS F F X P P P P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
9 CS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F P
Slow changes on domain
10 SS P P X P P P P P P P P P P P P P P P P F F F F F F F F F F P
Slow changes on domain
11 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Creator user name is empty in user trace sessions
12 CS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
13 SS P P X P F P P P P P P P P P P P P P P P P P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
14 CS P P P P P F X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
15 SS P P X P P F X X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
16 CS P P P P P P P P P P P P P P P P P P P P P F F F P P X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
17 SS P P X P P P P P P P P P P P P P P P P P P F F F P P X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
18 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Check ability to make connect to FB services and add/drop user

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1415
2024-06-10
5.0.1.1412
2024-06-09
5.0.1.1399
2024-05-15
5.0.1.1398
2024-05-14
5.0.1.1397
2024-05-09
5.0.1.1395
2024-05-08
5.0.1.1394
2024-05-06
5.0.1.1393
2024-05-02
5.0.1.1392
2024-04-30
5.0.1.1391
2024-04-29
5.0.1.1390
2024-04-27
5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-14
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1373
2024-04-01
5.0.1.1372
2024-03-29
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
Test TITLE
1 SS 34006 38679 38113 0 30566 33061 33611 37705 36201 34926 35060 55239 33021 34569 31932 32787 38643 32295 31142 34027 34336 34006 32680 33824 33586 34013 34473 33084 34011 31868 32440
Compress Data over the Network
2 CS 43338 40011 39897 93813 43361 49549 48845 44459 38705 42467 43305 21720 30862 40337 38952 41294 52499 47048 47797 40998 50176 40776 39383 48304 50423 43445 53256 41703 43316 49587 48709
Wrong results or unexpected errors while sorting a large data set
3 SS 38601 38194 34937 0 38601 43512 45771 39705 36003 36753 37596 30426 36541 36354 35608 37507 74171 44108 43660 37342 71665 36027 35161 43765 63466 56569 46547 36942 59092 44639 45141
Wrong results or unexpected errors while sorting a large data set
4 CS 7420 9879 11839 16221 11032 7314 8097 7994 7195 7105 8117 7506 7618 7340 7041 7241 7897 7250 7166 8638 7278 8017 6925 7054 7343 7249 9093 7577 7498 6982 7085
Ability to cancel waiting in lock manager
5 CS 11559 11580 11659 11978 11453 11364 11446 11627 11495 11581 11588 12802 11518 11360 11301 11370 11450 11438 11386 11624 11449 11579 11312 11570 11565 11560 11758 11559 11660 11583 11514
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
6 CS 18557 18509 18897 19601 19466 18541 18526 18461 18525 18783 18580 20384 18707 18451 18387 18557 18558 18519 18536 18455 18438 18581 18663 18527 18592 18398 18543 18585 18641 18693 18797
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
7 CS 697 804 816 1084 927 671 754 674 687 718 720 1190 699 710 627 714 659 665 668 680 660 721 717 653 672 670 698 668 697 732 636
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
8 SS 390 422 472 0 516 377 388 357 389 361 388 662 361 391 390 393 347 367 418 418 391 384 387 355 410 596 418 531 395 386 387
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
9 CS 7364 7267 7518 6925 6923 6856 7220 7343 6623 7392 7206 10518 7414 7030 6713 7260 7022 7096 6871 7386 8983 9834 8929 9084 10507 10666 10876 10549 11289 10762 6620
Slow changes on domain
10 SS 6844 6939 7247 0 6904 6634 6779 6844 6474 6497 6694 9382 6387 6433 6359 6799 6648 6299 6262 6825 8890 9078 8420 8441 10370 10252 10207 14003 10115 13824 6285
Slow changes on domain
11 CS 2595 2629 2589 2914 2874 2594 2591 2621 2646 2627 2601 2597 2594 2620 2566 2569 2616 2589 2568 2629 2583 2603 2589 2606 2591 2604 2574 2582 2606 2569 2576
Creator user name is empty in user trace sessions
12 CS 357 393 365 750 592 378 370 400 341 400 361 325 326 354 326 367 370 330 306 341 340 390 340 335 334 368 399 349 409 335 336
Extend rdb$get_context('SYSTEM', '***') with client-related info
13 SS 168 186 218 0 321 168 162 183 173 172 159 243 179 140 154 164 171 153 175 163 157 169 143 171 201 161 155 171 160 133 134
Extend rdb$get_context('SYSTEM', '***') with client-related info
14 CS 896 838 780 1010 954 690 1212 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
15 SS 512 512 506 0 536 430 754 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
16 CS 6714 6852 6904 6819 6689 6716 6739 6801 6638 6759 6681 6181 6678 6603 6616 5703 6605 6643 6629 6754 6638 6713 70064 69162 69242 13777 13727 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
17 SS 6242 6242 7233 0 6141 7022 5997 7105 6016 7164 6027 5805 6013 5973 7038 7083 6116 7004 6188 6087 6061 6065 68456 69609 68495 13166 13247 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
18 CS 846 894 904 1154 1135 850 810 878 871 845 829 1501 867 852 741 799 807 791 780 804 846 868 883 803 846 836 823 849 870 774 766
Check ability to make connect to FB services and add/drop user

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5236
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5995
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_user_management.py
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===