01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (7 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 35 runs (20 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (62 rows)
11. All tests: outcomes for previous 35 runs (2814 rows)
12. Skipped: tests which was intentionally excluded from execution (167 rows)

Generated UTC 22.08.2025 05:12
Tested: FB50.   Build / date: 5.0.4.1703-bd5ab06b / 2025.08.20;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 35 runs:

NN Test name mode
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
Test TITLE
1 CS P P P P P P P P P P P P P P F F F P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS P P P P P P P P P P P P P P F F F P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 SS P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P
Count (DISTINCT ...) is too slow
4 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
5 SS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
6 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
8 CS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
9 SS P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
10 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
11 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
12 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
13 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Add pointers tree to TempSpace class
14 CS P P P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
15 SS P P P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
16 CS X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X X X X X
Range based FOR is broken with a DO SUSPEND without BEGIN...END
17 SS X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X X X X X
Range based FOR is broken with a DO SUSPEND without BEGIN...END
18 CS P P P P P P P P P P P P P P P P P P P P P F P P X X X X X X X X X X X
Comparison of string and numeric literals
19 SS P P P P P P P P P P P P P P P P P P P P P F P P X X X X X X X X X X X
Comparison of string and numeric literals
20 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
Test TITLE
1 CS 718 780 752 753 738 775 740 767 775 774 755 779 718 750 746 1019 1024 1059 658 688 679 692 736 648 657 657 687 652 659 657 645 686 696 677 688 673
CREATE VIEW ignores PLAN
2 SS 480 495 482 480 496 493 496 511 539 496 499 493 468 495 516 781 797 777 441 442 454 439 441 461 449 445 455 464 444 434 451 457 463 490 444 676
CREATE VIEW ignores PLAN
3 SS 17630 17480 17395 17823 17588 17642 17689 17975 18877 18622 17877 18106 17781 17983 17963 17437 17630 17519 17421 17297 18035 17565 17564 19433 17428 17533 17333 17336 17321 17540 17815 17487 17866 17617 18586 18093
Count (DISTINCT ...) is too slow
4 CS 2277 2239 2225 2205 2270 2266 2286 2277 2299 2300 2219 2291 2141 2280 2280 2269 2342 12780 2326 2282 2269 2279 2316 2284 2261 2262 2219 2260 2297 2314 2252 2230 2243 2290 2305 2273
New gbak option to enable encryption during restore
5 SS 1567 1608 1656 1558 1571 1613 1556 1574 1545 1559 1573 1569 1469 1552 1564 1547 1558 12109 1641 1565 1680 1593 1578 1567 1570 1551 1557 1554 1577 1558 1539 1566 1567 1583 1566 1579
New gbak option to enable encryption during restore
6 CS 3054 3054 3044 3162 4028 3047 3496 3042 3054 3052 3047 3067 3015 3043 3049 3044 3258 3055 3256 3069 3046 3073 3076 3046 3059 3049 3147 3052 3056 3192 3048 3054 3052 3074 3042 3098
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 SS 2849 3897 2857 2853 2844 2838 2841 2849 2852 2858 2836 2844 2828 3088 2837 2849 2842 2846 2894 2850 2847 2847 2853 2841 2857 2843 2874 3090 2845 2856 2835 2852 2839 2856 2850 2846
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
8 CS 1585 1580 1568 1577 1583 1624 1592 1561 1563 1608 1579 1558 1437 1599 1596 1566 1564 12365 1561 1639 1596 1624 1599 1590 1596 1617 1585 1578 1598 1567 1562 1562 1598 1582 1585 1595
Restore of encrypted backup of database with SQL dialect 1 fails
9 SS 1135 1130 1135 1173 1147 1140 1149 1146 1134 1166 1157 1114 1094 1127 1134 1135 1130 11902 1128 1129 1150 1128 1140 1135 1173 1130 1127 1171 1135 1155 1137 1127 1158 1175 1119 1222
Restore of encrypted backup of database with SQL dialect 1 fails
10 SS 383 387 379 377 381 381 383 389 378 389 391 395 375 401 376 388 382 391 383 400 400 378 379 375 382 382 389 376 731 404 370 379 387 407 388 391
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
11 CS 890 891 940 883 882 905 889 896 890 885 884 899 875 888 901 919 893 889 888 882 923 891 907 884 880 884 887 878 893 902 889 990 899 956 1179 890
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
12 SS 654 648 662 649 675 646 660 654 667 651 704 654 626 647 652 657 653 662 645 653 713 699 645 681 649 650 649 654 662 665 648 651 660 666 953 672
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
13 CS 23077 23606 22947 22977 22823 22701 22817 22925 23288 23729 23699 23077 22109 22678 22739 22637 23159 23276 22945 22949 23616 23229 22934 23002 23283 23087 23411 23106 22957 23295 22851 22510 25387 25562 24974 25462
Add pointers tree to TempSpace class
14 CS 9709 9882 9667 9606 9807 9709 9701 9731 10003 1937 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
15 SS 7814 9338 9415 7814 9465 7779 7775 7809 9501 1594 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
16 CS 954 0 0 0 0 0 0 0 0 0 0 954 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Range based FOR is broken with a DO SUSPEND without BEGIN...END
17 SS 782 0 0 0 0 0 0 0 0 0 0 782 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Range based FOR is broken with a DO SUSPEND without BEGIN...END
18 CS 585 586 580 578 587 619 582 633 612 579 577 575 562 606 1157 601 571 584 577 588 608 640 586 576 579 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
19 SS 377 388 376 396 378 375 376 372 391 413 412 649 359 377 376 391 391 373 377 397 371 374 385 374 387 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
20 SS 690 682 675 774 716 678 695 685 678 684 672 712 656 693 684 693 709 700 703 760 703 684 711 676 706 673 690 689 678 686 748 708 712 750 689 689
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-4524
http://tracker.firebirdsql.org/browse/CORE-5488
http://tracker.firebirdsql.org/browse/CORE-6071
http://tracker.firebirdsql.org/browse/CORE-6185
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_user_management_in_selfsec_db.py
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8421
https://github.com/FirebirdSQL/firebird/issues/8598
https://github.com/FirebirdSQL/firebird/issues/8625
=== end of list ===

Last commits information (all timestamps in UTC):