01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (8 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 35 runs (18 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (3 rows)
11. All tests: outcomes for previous 35 runs (2652 rows)
12. Skipped: tests which was intentionally excluded from execution (168 rows)

Generated UTC 29.07.2025 04:14
Tested: FB50.   Build / date: 5.0.3.1690-19167ffe / 2025.07.28;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 35 runs:

NN Test name mode
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
Test TITLE
1 CS P P P P P P P P F F F P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS P P P P P P P P F F F P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 CS P P F F F F F F F F P P P P P P P P P P P P P P P P P P P P P P P P P
Maximum key size using PXW_CSY collation
4 SS P P F F F F F F F F P P P P P P P P P P P P P P P P P P P P P P P P P
Maximum key size using PXW_CSY collation
5 CS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
6 SS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
7 SS P F P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
8 SS P P P P P P P P F P P P P P P P P P P P P F P P P P P P P F P P F P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
9 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
10 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
11 CS P P F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 SS P P F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
13 CS P F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
14 SS P F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
15 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P
External Connections Pool, functionality test 01
16 CS P P P P P P P P P P P P P P P F P P X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
17 SS P P P P P P P P P P P P P P P F P P X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
18 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
Test TITLE
1 CS 923 931 929 871 957 826 871 947 935 1020 980 1017 818 921 811 813 1081 980 933 1051 886 1004 923 920 901 934 884 911 974 978 903 831 865 946 866 904
CREATE VIEW ignores PLAN
2 SS 602 557 635 616 558 584 523 522 624 642 633 681 531 559 527 599 662 585 560 646 600 613 640 522 635 591 603 611 612 623 604 529 602 642 591 556
CREATE VIEW ignores PLAN
3 CS 726 708 681 795 884 874 854 879 812 654 685 654 683 625 646 730 761 770 652 722 741 793 791 747 782 726 703 756 751 750 691 624 637 684 691 673
Maximum key size using PXW_CSY collation
4 SS 414 378 390 560 538 625 525 643 521 416 338 359 392 370 376 354 368 434 390 426 414 458 487 352 424 379 431 449 413 395 413 418 418 386 363 425
Maximum key size using PXW_CSY collation
5 CS 2667 2478 2543 2438 2461 2571 2478 2503 2406 2520 2396 12039 2344 2487 2455 2514 2758 2775 2791 3032 2968 2929 2875 2843 2808 2670 2703 2681 2736 2809 2667 2568 2434 2681 2593 2793
New gbak option to enable encryption during restore
6 SS 1675 1615 1566 1558 1594 1534 1627 1572 1478 1507 1574 11164 1476 1555 1578 1688 1705 1735 1721 1734 1727 1797 1708 1675 1740 1777 1679 1682 1814 1715 1717 1696 1637 1648 1660 1622
New gbak option to enable encryption during restore
7 SS 4483 4145 4984 3995 3979 4146 4260 4114 4026 4385 3968 4000 4462 4284 3994 3899 5164 5159 6001 6031 5554 5231 6380 6679 6012 5726 5458 6348 4968 5042 4340 4284 4349 5127 4885 4483
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
8 SS 2715 2688 2700 2713 2668 2700 2674 2741 2683 2655 2693 2689 2693 2694 2691 2731 2755 2751 2719 2794 2765 2790 3039 2745 2718 2734 2745 2738 2725 2706 2900 2708 2684 2992 2715 2682
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
9 CS 1434 1284 1370 1381 1382 1281 1389 1429 1434 1424 1391 1303 1412 1405 1305 1615 1576 1654 1750 1299 1782 1786 1790 1652 1654 1685 1692 1585 1851 1752 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
10 SS 1200 1022 1243 1132 1094 1200 1127 1053 1081 1269 1135 1046 1224 1067 1100 1130 1340 1167 1419 1391 1444 1450 1374 1188 1274 1319 1093 1248 1559 1309 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
11 CS 32689 33226 32411 32701 32677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 SS 32743 33016 32503 32983 32468 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
13 CS 913 1201 1416 826 913 831 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
14 SS 509 714 722 483 509 500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
15 CS 29994 29547 29705 29692 29527 29603 29690 29385 29615 29648 29610 29345 29554 29549 29481 29997 30078 30405 30232 30366 30415 30461 30362 30168 30163 30379 30309 30191 30278 30135 29944 29994 29951 30288 30016 29844
External Connections Pool, functionality test 01
16 CS 657 628 608 734 608 641 687 634 684 627 622 649 576 665 713 677 777 783 779 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
17 SS 405 419 412 407 395 411 378 404 393 378 346 375 394 406 388 427 433 439 436 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
18 SS 983 986 915 831 971 940 938 1001 935 917 952 934 885 893 930 983 1065 1065 1094 1129 1077 1089 1179 936 946 1061 1123 920 1057 971 942 1117 1095 990 999 1124
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1802
http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-4524
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_user_management_in_selfsec_db.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8598
https://github.com/FirebirdSQL/firebird/issues/8649
=== end of list ===

Last commits information (all timestamps in UTC):