01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (28 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (17 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2572 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 23.02.2025 04:12
Tested: FB50.   Build / date: 5.0.3.1622-c1a518f0 / 2025.02.22;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
5.0.2.1606
2025.02.01
5.0.2.1605
2025.01.31
5.0.2.1604
2025.01.27
5.0.2.1602
2025.01.24
5.0.2.1601
2025.01.21
5.0.2.1597
2025.01.20
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
5.0.2.1577
2024.12.11
5.0.2.1576
2024.12.10
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.02
Test TITLE
1 CS P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
2 SS P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
3 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Ability to cancel waiting in lock manager
4 CS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
5 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
6 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
7 SS P P P P F P P P P P P P P P P P P P P P F P P P P P P P P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
8 CS P P P F P P P P P P P P P P P P P P F P P P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
9 SS P P P P P P F P P P P P P P P P P P P P F F P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
10 SS P F P F P P P P P P P P F P F P P P P P P P P P P P P P P P
Events in system attachments (like garbage collector) are not traced
11 CS P P P P P P P P P P P P P P P P P P P P P F P P F F P P P P
Memory leak when executing a lot of different queries and StatementTimeout > 0
12 SS P P P P P P P P P P P P P P P P P P P P F F P P P P P P P P
Memory leak when executing a lot of different queries and StatementTimeout > 0
13 CS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
14 SS P P P P P P P P P P P P P P P P P P P F F F F F F F F F F F
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
15 SS P P P P P P P P P P P P P F X X X X X X X X X X X X X X X X
gbak: Incorrect total statistics for restore
16 CS P P P F P P P P P P P P P P P P P P P P P F P P P P P P P P
External Connections Pool, functionality test 01
17 CS P P F P P P F P F P P P P P P P P P P P P P P P P P P P P P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
5.0.2.1606
2025.02.01
5.0.2.1605
2025.01.31
5.0.2.1604
2025.01.27
5.0.2.1602
2025.01.24
5.0.2.1601
2025.01.21
5.0.2.1597
2025.01.20
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
5.0.2.1577
2024.12.11
5.0.2.1576
2024.12.10
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.02
Test TITLE
1 CS 821 873 801 828 774 834 833 805 815 790 737 1492 866 804 965 856 909 899 827 845 837 736 1370 626 639 721 1154 672 648 665 710
Improve sorting performance when long VARCHARs are involved
2 SS 439 485 431 457 442 470 416 486 488 436 440 518 419 480 430 450 461 436 469 439 456 462 474 360 336 339 364 341 369 340 353
Improve sorting performance when long VARCHARs are involved
3 CS 3593 3698 3526 3613 4208 3735 3573 3587 3652 3481 3638 4191 3536 3761 3799 3713 3582 3544 3603 3708 3600 3894 4425 3449 3499 3432 3536 3521 3418 3566 3451
Ability to cancel waiting in lock manager
4 CS 794 839 841 799 960 892 712 821 790 799 817 678 831 851 758 776 742 831 852 694 774 1243 1221 599 594 564 1195 654 567 644 586
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
5 CS 903 939 988 923 1553 894 976 892 994 840 943 1576 1035 911 989 916 985 863 896 957 894 752 828 764 774 719 1136 709 710 758 821
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
6 CS 739 858 687 738 1252 824 737 736 751 758 740 645 728 716 798 807 837 781 746 763 765 690 1291 581 569 576 1005 590 579 566 550
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
7 SS 425 429 395 451 449 431 438 431 464 489 418 584 501 406 430 402 431 414 393 466 421 602 565 317 333 342 329 338 325 339 293
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
8 CS 3029 3130 3074 2991 3681 3107 3090 3062 3073 3092 3045 2964 3054 3025 3028 3013 3036 3031 3016 3098 3030 2997 2993 2859 2879 2920 3348 2890 2902 2896 2899
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
9 SS 2755 2798 2801 2810 2777 2733 2764 2803 2758 2878 2751 2643 2792 2824 2800 2744 2775 2716 2780 2753 2735 3031 3060 2614 2589 2625 2643 2633 2647 2621 2620
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
10 SS 1280 1339 1237 1175 1731 1456 1443 1398 1287 1273 1245 1287 1322 1441 1435 1688 1238 1341 1239 1440 1586 1754 1218 1061 1065 1082 1182 1020 1100 1160 1018
Events in system attachments (like garbage collector) are not traced
11 CS 723 842 767 747 1236 743 777 709 699 680 730 702 705 815 717 762 819 760 712 813 738 1085 1262 590 608 595 549 627 663 605 581
Memory leak when executing a lot of different queries and StatementTimeout > 0
12 SS 429 475 384 454 630 442 415 394 427 432 442 592 437 416 443 451 420 441 439 409 451 579 621 335 310 310 336 336 304 313 338
Memory leak when executing a lot of different queries and StatementTimeout > 0
13 CS 11562 11883 11844 11740 12933 13344 13431 12238 11921 11591 11552 18608 11426 11684 11806 11735 11547 11508 11396 11573 11469 18192 11519 9501 9973 9549 9823 9891 9429 9743 9765
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
14 SS 11414 12766 11366 11258 21078 12113 11583 12127 11462 11477 11524 18547 11342 11656 11716 11715 11260 11261 11025 11085 11623 18605 19031 9154 9313 9271 9398 9427 9315 9382 9678
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
15 SS 8399 8840 8379 8059 13921 9470 8114 8809 8347 7664 8420 11831 8531 7777 8192 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gbak: Incorrect total statistics for restore
16 CS 740 827 797 696 670 773 819 774 802 735 645 1133 732 764 770 728 818 753 730 768 746 684 1144 654 594 606 1046 598 582 623 552
External Connections Pool, functionality test 01
17 CS 55991 56276 56559 55174 63319 56574 56132 55966 56324 56171 55658 60452 55913 56205 56337 56437 56461 56094 56017 55424 55851 62734 52042 50954 50708 50371 52831 51481 50338 50608 50471
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-2650
http://tracker.firebirdsql.org/browse/CORE-3323
http://tracker.firebirdsql.org/browse/CORE-5210
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_merge_deny_multiple_matches.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8085
https://github.com/FirebirdSQL/firebird/issues/8185
https://github.com/FirebirdSQL/firebird/issues/8391
=== end of list ===

Last commits information (all timestamps in UTC):