01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (10 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 35 runs (16 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 35 runs (2852 rows)
12. Skipped: tests which was intentionally excluded from execution (167 rows)

Generated UTC 14.09.2025 12:48
Tested: FB50.   Build / date: 5.0.4.1713-6997fa10 / 2025.09.13;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 35 runs:

NN Test name mode
5.0.4.1713
2025.09.13
5.0.4.1711
2025.09.09
5.0.4.1706
2025.09.07
5.0.4.1704
2025.08.28
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS P P P P P P P P P P P P P P P P P P F F F P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P
Count (DISTINCT ...) is too slow
4 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
5 SS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
6 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
8 SS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
9 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
10 CS P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Add pointers tree to TempSpace class
11 CS P P P P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 SS P P P P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X X X
Don't fire referential integrity triggers if primary or unique keys haven't changed
13 CS X X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Range based FOR is broken with a DO SUSPEND without BEGIN...END
14 SS X X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Range based FOR is broken with a DO SUSPEND without BEGIN...END
15 CS P P P P P P P P P P P P P P P P P P P P P P P P P F P P X X X X X X X
Comparison of string and numeric literals
16 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P P X X X X X X X
Comparison of string and numeric literals

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.4.1713
2025.09.13
5.0.4.1711
2025.09.09
5.0.4.1706
2025.09.07
5.0.4.1704
2025.08.28
5.0.4.1703
2025.08.20
5.0.4.1701
2025.08.07
5.0.4.1697
2025.08.06
5.0.4.1696
2025.08.04
5.0.3.1693
2025.07.30
5.0.3.1690
2025.07.28
5.0.3.1689
2025.07.24
5.0.3.1686
2025.07.23
5.0.3.1684
2025.07.23
5.0.3.1684
2025.07.19
5.0.3.1683
2025.07.12
5.0.3.1681
2025.07.11
5.0.3.1679
2025.07.09
5.0.3.1676
2025.07.01
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
Test TITLE
1 CS 740 750 740 778 747 734 752 753 738 775 740 767 775 774 755 779 718 750 746 1019 1024 1059 658 688 679 692 736 648 657 657 687 652 659 657 645 686
CREATE VIEW ignores PLAN
2 SS 482 468 492 504 485 494 482 480 496 493 496 511 539 496 499 493 468 495 516 781 797 777 441 442 454 439 441 461 449 445 455 464 444 434 451 457
CREATE VIEW ignores PLAN
3 SS 17642 17578 18260 18034 17822 17898 17395 17823 17588 17642 17689 17975 18877 18622 17877 18106 17781 17983 17963 17437 17630 17519 17421 17297 18035 17565 17564 19433 17428 17533 17333 17336 17321 17540 17815 17487
Count (DISTINCT ...) is too slow
4 CS 2279 2157 2243 2282 2286 2282 2225 2205 2270 2266 2286 2277 2299 2300 2219 2291 2141 2280 2280 2269 2342 12780 2326 2282 2269 2279 2316 2284 2261 2262 2219 2260 2297 2314 2252 2230
New gbak option to enable encryption during restore
5 SS 1566 1484 1576 1573 1551 1581 1656 1558 1571 1613 1556 1574 1545 1559 1573 1569 1469 1552 1564 1547 1558 12109 1641 1565 1680 1593 1578 1567 1570 1551 1557 1554 1577 1558 1539 1566
New gbak option to enable encryption during restore
6 CS 3054 3172 3517 3047 3050 3052 3044 3162 4028 3047 3496 3042 3054 3052 3047 3067 3015 3043 3049 3044 3258 3055 3256 3069 3046 3073 3076 3046 3059 3049 3147 3052 3056 3192 3048 3054
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 CS 1590 1547 1591 1590 1591 1617 1568 1577 1583 1624 1592 1561 1563 1608 1579 1558 1437 1599 1596 1566 1564 12365 1561 1639 1596 1624 1599 1590 1596 1617 1585 1578 1598 1567 1562 1562
Restore of encrypted backup of database with SQL dialect 1 fails
8 SS 1137 1094 1156 1139 1140 1150 1135 1173 1147 1140 1149 1146 1134 1166 1157 1114 1094 1127 1134 1135 1130 11902 1128 1129 1150 1128 1140 1135 1173 1130 1127 1171 1135 1155 1137 1127
Restore of encrypted backup of database with SQL dialect 1 fails
9 SS 382 375 380 386 389 405 379 377 381 381 383 389 378 389 391 395 375 401 376 388 382 391 383 400 400 378 379 375 382 382 389 376 731 404 370 379
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
10 CS 23002 22563 23128 23196 23168 23137 22947 22977 22823 22701 22817 22925 23288 23729 23699 23077 22109 22678 22739 22637 23159 23276 22945 22949 23616 23229 22934 23002 23283 23087 23411 23106 22957 23295 22851 22510
Add pointers tree to TempSpace class
11 CS 9707 9391 9774 9707 9743 9624 9667 9606 9807 9709 9701 9731 10003 1937 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
12 SS 7779 7703 7714 9568 7718 7727 9415 7814 9465 7779 7775 7809 9501 1594 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Don't fire referential integrity triggers if primary or unique keys haven't changed
13 CS 954 0 0 0 0 0 0 0 0 0 0 0 0 0 0 954 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Range based FOR is broken with a DO SUSPEND without BEGIN...END
14 SS 782 0 0 0 0 0 0 0 0 0 0 0 0 0 0 782 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Range based FOR is broken with a DO SUSPEND without BEGIN...END
15 CS 585 578 614 610 579 611 580 578 587 619 582 633 612 579 577 575 562 606 1157 601 571 584 577 588 608 640 586 576 579 0 0 0 0 0 0 0
Comparison of string and numeric literals
16 SS 377 359 394 387 396 374 376 396 378 375 376 372 391 413 412 649 359 377 376 391 391 373 377 397 371 374 385 374 387 0 0 0 0 0 0 0
Comparison of string and numeric literals

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-4524
http://tracker.firebirdsql.org/browse/CORE-5488
http://tracker.firebirdsql.org/browse/CORE-6071
http://tracker.firebirdsql.org/browse/CORE-6185
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird/issues/8421
https://github.com/FirebirdSQL/firebird/issues/8598
https://github.com/FirebirdSQL/firebird/issues/8625
=== end of list ===

Last commits information (all timestamps in UTC):