01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (16 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2655 rows)
12. Skipped: tests which was intentionally excluded from execution (77 rows)

Generated UTC 28.06.2025 06:05
Tested: FB50.   Build / date: 5.0.3.1675-1bb2c1e3 / 2025.06.27;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.12
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.27
5.0.3.1636
2025.03.26
Test TITLE
1 CS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 SS P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Count (DISTINCT ...) is too slow
4 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
5 SS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
New gbak option to enable encryption during restore
6 CS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
7 SS P P F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Restore of encrypted backup of database with SQL dialect 1 fails
8 SS P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
9 SS P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
10 CS P P P P P P P P P P P P P P P P P P P F P X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
11 SS P P P P P P P P P P P P P P P P P P P F P X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
12 CS X X X X X X X X X X X X X X X X X X X X X X X F X X X X X X
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
13 SS X X X X X X X X X X X X X X X X X X X X X X X F X X X X X X
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
14 CS P P P P P P P F P P X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
15 SS P P P P P P P F P P X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
16 SS P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1675
2025.06.27
5.0.3.1674
2025.06.26
5.0.3.1673
2025.06.25
5.0.3.1668
2025.06.21
5.0.3.1667
2025.06.15
5.0.3.1666
2025.06.14
5.0.3.1665
2025.06.11
5.0.3.1661
2025.06.10
5.0.3.1660
2025.06.07
5.0.3.1659
2025.05.28
5.0.3.1658
2025.05.27
5.0.3.1657
2025.05.22
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.12
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.27
5.0.3.1636
2025.03.26
Test TITLE
1 CS 673 1034 1024 1059 658 688 679 692 736 648 657 657 687 652 659 657 645 686 696 677 688 673 658 641 698 673 660 663 661 666 726
CREATE VIEW ignores PLAN
2 SS 458 787 797 777 441 442 454 439 441 461 449 445 455 464 444 434 451 457 463 490 444 676 434 438 477 470 461 468 460 491 481
CREATE VIEW ignores PLAN
3 SS 17536 17465 17630 17519 17421 17297 18035 17565 17564 19433 17428 17533 17333 17336 17321 17540 17815 17487 17866 17617 18586 18093 17181 17078 17609 17618 17065 17097 17417 17587 17682
Count (DISTINCT ...) is too slow
4 CS 2283 2328 2342 12780 2326 2282 2269 2279 2316 2284 2261 2262 2219 2260 2297 2314 2252 2230 2243 2290 2305 2273 2284 2187 2262 2266 2301 2330 2259 2338 2325
New gbak option to enable encryption during restore
5 SS 1572 1568 1558 12109 1641 1565 1680 1593 1578 1567 1570 1551 1557 1554 1577 1558 1539 1566 1567 1583 1566 1579 1577 1468 1574 1646 1567 1589 1591 1640 1641
New gbak option to enable encryption during restore
6 CS 1595 1572 1564 12365 1561 1639 1596 1624 1599 1590 1596 1617 1585 1578 1598 1567 1562 1562 1598 1582 1585 1595 1643 1531 1583 1609 1592 1619 1624 1600 1671
Restore of encrypted backup of database with SQL dialect 1 fails
7 SS 1138 1137 1130 11902 1128 1129 1150 1128 1140 1135 1173 1130 1127 1171 1135 1155 1137 1127 1158 1175 1119 1222 1131 1125 1146 1133 1149 1167 1162 1221 1195
Restore of encrypted backup of database with SQL dialect 1 fails
8 SS 387 386 382 391 383 400 400 378 379 375 382 382 389 376 731 404 370 379 387 407 388 391 384 375 398 385 424 390 404 413 423
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
9 SS 21431 21421 21420 21465 21424 21435 21425 21397 21440 21426 21436 21428 21424 21444 21425 21432 21428 21437 21456 21431 21418 21428 21430 22718 21434 21437 21453 21416 21438 21456 21466
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
10 CS 890 881 893 889 888 882 923 891 907 884 880 884 887 878 893 902 889 990 899 956 1179 890 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
11 SS 657 657 653 662 645 653 713 699 645 681 649 650 649 654 662 665 648 651 660 666 953 672 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
12 CS 862 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 862 0 0 0 0 0 0
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
13 SS 644 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 644 0 0 0 0 0 0
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
14 CS 585 616 571 584 577 588 608 640 586 576 579 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
15 SS 379 382 391 373 377 397 371 374 385 374 387 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
16 SS 701 697 709 700 703 760 703 684 711 676 706 673 690 689 678 686 748 708 712 750 689 689 733 656 735 697 721 690 686 761 713
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-4524
http://tracker.firebirdsql.org/browse/CORE-6071
http://tracker.firebirdsql.org/browse/CORE-6185
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_user_management_in_selfsec_db.py
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8501
=== end of list ===

Last commits information (all timestamps in UTC):