01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (1 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (13 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 35 runs (22 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (6 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 35 runs (2865 rows)
12. Skipped: tests which was intentionally excluded from execution (169 rows)

Generated UTC 02.10.2025 06:20
Tested: FB50.   Build / date: 5.0.4.1722-d92e2d8c / 2025.10.01;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 35 runs:

NN Test name mode
5.0.4.1722
2025.10.01
5.0.4.1720
2025.09.30
5.0.4.1717
2025.09.29
5.0.4.1715
2025.09.24
5.0.4.1714
2025.09.15
5.0.4.1713
2025.09.13
5.0.4.1711
2025.09.09
5.0.4.1706
2025.09.07
5.0.4.1704
2025.08.28
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS P P P P P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P
CREATE VIEW ignores PLAN
3 CS P P P P P P P P P P P P P P P P F F F F F F F F P P P P P P P P P P P
Maximum key size using PXW_CSY collation
4 SS P P P P P P P P P P P P P P P P F F F F F F F F P P P P P P P P P P P
Maximum key size using PXW_CSY collation
5 SS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
6 CS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P
New gbak option to enable encryption during restore
7 SS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P
New gbak option to enable encryption during restore
8 SS P F P P P P P P P P P P P P P F P P P P P P F P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
9 SS P P P P F P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
10 CS P P P P P P P P P P P P P P P P F F X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
11 SS P P P P P P P P P P P P P P P P F F X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 CS P P P P P P P P P P P P P P P F F F F X X X X X X X X X X X X X X X X
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
13 SS P P P P P P P P P P P P P P P F F F F X X X X X X X X X X X X X X X X
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
14 CS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test of NESTED PROCEDURES functionality
15 SS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test of NESTED PROCEDURES functionality
16 CS X X X X F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test of packages names resolution - usage of scope specifier '%package'
17 SS X X X X F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test of packages names resolution - usage of scope specifier '%package'
18 CS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Support for NOT SINGULAR when subquery refers to another table
19 SS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Support for NOT SINGULAR when subquery refers to another table
20 CS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
External Connections Pool, functionality test 01
21 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P X X X
Comparison of string and numeric literals
22 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P X X X
Comparison of string and numeric literals

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.4.1722
2025.10.01
5.0.4.1720
2025.09.30
5.0.4.1717
2025.09.29
5.0.4.1715
2025.09.24
5.0.4.1714
2025.09.15
5.0.4.1713
2025.09.13
5.0.4.1711
2025.09.09
5.0.4.1706
2025.09.07
5.0.4.1704
2025.08.28
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
Test TITLE
1 CS 929 1737 1319 1430 901 901 889 947 903 896 953 919 915 918 965 891 929 871 957 826 871 947 935 1020 980 1017 818 921 811 813 1081 980 933 1051 886 1004
CREATE VIEW ignores PLAN
2 SS 605 718 799 896 630 629 477 496 607 605 636 586 558 617 536 553 635 616 558 584 523 522 624 642 633 681 531 559 527 599 662 585 560 646 600 613
CREATE VIEW ignores PLAN
3 CS 722 1073 1038 1041 681 697 654 705 762 692 689 682 688 726 668 740 681 795 884 874 854 879 812 654 685 654 683 625 646 730 761 770 652 722 741 793
Maximum key size using PXW_CSY collation
4 SS 414 577 580 613 393 445 455 422 402 385 414 389 386 476 413 366 390 560 538 625 525 643 521 416 338 359 392 370 376 354 368 434 390 426 414 458
Maximum key size using PXW_CSY collation
5 SS 16856 24023 26057 26612 57923 16967 15702 15744 16064 15778 16282 16626 17933 16477 16598 17541 17327 16950 16891 16651 16856 16711 16472 16039 16560 16207 16378 16703 16697 18120 18402 18388 17700 18614 16916 17711
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
6 CS 2543 3626 3675 3653 2495 2543 2577 2390 2572 2491 2508 2507 2639 2683 2518 2581 2543 2438 2461 2571 2478 2503 2406 2520 2396 12039 2344 2487 2455 2514 2758 2775 2791 3032 2968 2929
New gbak option to enable encryption during restore
7 SS 1627 2106 2202 2210 1618 1695 1557 1615 1646 1643 1724 1574 1596 1676 1671 1592 1566 1558 1594 1534 1627 1572 1478 1507 1574 11164 1476 1555 1578 1688 1705 1735 1721 1734 1727 1797
New gbak option to enable encryption during restore
8 SS 4114 6310 6445 6369 4185 4169 3881 3849 3894 3737 3942 3979 4056 4100 4019 4032 4984 3995 3979 4146 4260 4114 4026 4385 3968 4000 4462 4284 3994 3899 5164 5159 6001 6031 5554 5231
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
9 SS 2705 2848 2824 2830 2728 2885 2692 2695 2630 2711 2728 2705 2679 2687 2690 2721 2700 2713 2668 2700 2674 2741 2683 2655 2693 2689 2693 2694 2691 2731 2755 2751 2719 2794 2765 2790
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
10 CS 32689 49571 53380 52987 32822 31758 31349 33184 34583 34960 34974 30411 31510 31557 31742 32314 32411 32701 32677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
11 SS 33022 18257 52721 56454 35080 33396 31383 32949 34652 34153 33667 32266 33468 32335 30166 33061 32503 32983 32468 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 CS 1381 2042 1876 2059 1312 1436 1285 1349 1413 1281 1385 1288 1381 1383 1391 1301 1416 826 913 831 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
13 SS 750 887 1112 1075 750 754 764 765 766 686 772 778 731 700 682 681 722 483 509 500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
AV when ON CONNECT triggers uses EXECUTE STATEMENT ON EXTERNAL
14 CS 2135 2424 2290 2135 1452 1734 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Test of NESTED PROCEDURES functionality
15 SS 955 921 1294 1241 899 955 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Test of NESTED PROCEDURES functionality
16 CS 1295 0 0 0 0 1295 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Test of packages names resolution - usage of scope specifier '%package'
17 SS 851 0 0 0 0 851 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Test of packages names resolution - usage of scope specifier '%package'
18 CS 2213 2221 2299 2206 1938 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Support for NOT SINGULAR when subquery refers to another table
19 SS 1656 837 1782 1801 1531 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Support for NOT SINGULAR when subquery refers to another table
20 CS 29690 31715 31898 31346 29574 29865 29548 29579 29755 29677 29846 29647 29873 29688 29759 29502 29705 29692 29527 29603 29690 29385 29615 29648 29610 29345 29554 29549 29481 29997 30078 30405 30232 30366 30415 30461
External Connections Pool, functionality test 01
21 CS 669 1039 1026 883 588 650 673 683 681 642 685 644 661 661 624 727 608 734 608 641 687 634 684 627 622 649 576 665 713 677 777 783 779 0 0 0
Comparison of string and numeric literals
22 SS 402 534 513 561 423 403 413 401 380 380 364 386 433 391 344 386 412 407 395 411 378 404 393 378 346 375 394 406 388 427 433 439 436 0 0 0
Comparison of string and numeric literals

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1802
http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-4337
http://tracker.firebirdsql.org/browse/CORE-4524
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_nested_proc_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_packages_name_resolution_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_sql_predicates_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/8598
https://github.com/FirebirdSQL/firebird/issues/8649
=== end of list ===

Last commits information (all timestamps in UTC):