01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (27 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (3 rows)
07. Has fails: tests with at least one fail for previous 30 runs (79 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (3425 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 27.06.2025 11:34
Tested: HQ50.   Build / date: 5.0.3.1657-dcb8a089 / 2025.06.26;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
Test TITLE
1 CS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 CS F F F F F F F F F F F F P P F F F F F P P F F P F F F P P P
Compress Data over the Network
4 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Events in system attachments (like garbage collector) are not traced
7 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
8 SS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS F F F F F F F F E E E E E E F E E E E F F F F F F F F F F X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
PERCENT_RANK may return NaN instead of 0
13 SS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
PERCENT_RANK may return NaN instead of 0
14 CS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
15 SS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
16 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
17 SS F F F F F F F F E E E E E E F E E E E F F F F F F E F F F F
ORDER BY ASC using index (multi)
18 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
19 SS F F F F F F F F E E E E E E F E E E E F F F F F F E F F F F
ORDER BY ASC using index (multi)
20 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
21 SS F F F F F F F F E E E E E E F E E E E F F F F F F E F F F F
ORDER BY ASC using index (multi) and WHERE clause
22 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ISQL - SHOW SYSTEM TABLES
23 SS F F F F F F F F E E E E E E F E E E E F F F F F F E F F F F
ISQL - SHOW SYSTEM TABLES
24 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
25 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
26 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
27 SS F F F F F F F F E E E E E E F E E E E F F F F F F E F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
Test TITLE
1 CS 675 1021 1038 664 693 681 666 662 661 667 710 660 683 655 666 736 658 661 668 691 673 673 1041 695 685 727 689 684 672 677 667
CREATE VIEW ignores PLAN
2 SS 460 827 787 445 440 487 433 441 439 441 463 454 452 444 469 458 439 449 454 469 492 476 474 455 564 477 493 455 480 468 482
CREATE VIEW ignores PLAN
3 CS 16971 17048 16507 16816 17075 16766 17487 16823 16519 16559 17308 16624 16966 16304 16353 16455 16787 16977 17080 17338 16997 17108 19684 17369 17187 17231 17656 16996 16698 16271 16309
Compress Data over the Network
4 CS 1494 1460 1455 1477 1461 1492 1468 1474 1451 1469 1519 1533 1506 1845 1803 1465 1476 1497 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482 1832
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 SS 1034 959 913 1030 1030 1014 1020 1190 1234 1433 1183 1228 826 1249 999 1239 1234 921 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956 741
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 303 293 287 295 522 578 530 288 292 285 302 291 331 295 302 297 298 325 318 413 325 328 291 571 326 324 295 429 301 570 304
Events in system attachments (like garbage collector) are not traced
7 CS 595 609 580 638 582 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
8 SS 393 392 387 394 394 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
9 CS 1068 1050 1040 1022 1026 1098 1068 1065 1032 1047 1041 1034 1033 1103 1084 1041 1063 1070 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091 1104
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS 1094 1074 1069 1100 1062 1120 1111 1066 1057 1122 1095 1093 1092 1101 1102 1109 1109 1104 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS 884 851 845 840 841 871 860 839 844 2390 2388 2392 2235 2405 2382 839 2402 2418 2391 2416 925 877 886 842 887 857 868 1113 870 884 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS 607 620 600 615 583 593 616 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PERCENT_RANK may return NaN instead of 0
13 SS 391 392 390 391 396 401 387 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PERCENT_RANK may return NaN instead of 0
14 CS 609 609 606 610 618 590 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
15 SS 392 393 390 392 393 388 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
16 CS 841 852 807 843 834 843 849 832 811 838 853 840 885 844 855 831 828 856 867 1108 840 853 833 843 849 894 828 810 831 827 818
ORDER BY ASC using index (multi)
17 SS 597 535 551 537 525 548 569 775 555 2400 2384 2398 2256 2412 2398 566 2229 2393 2401 2429 576 611 611 558 584 581 2405 682 571 569 574
ORDER BY ASC using index (multi)
18 CS 845 851 833 848 833 843 817 797 812 829 847 833 844 868 849 816 850 851 858 916 856 854 836 844 889 898 851 833 842 811 854
ORDER BY ASC using index (multi)
19 SS 600 531 542 567 548 555 529 526 549 2230 2237 2235 2395 2383 2233 562 2410 2419 2404 2436 597 609 595 559 604 570 2239 613 561 843 564
ORDER BY ASC using index (multi)
20 CS 630 655 600 631 640 662 604 598 627 643 637 621 642 623 878 632 637 649 628 716 668 629 594 629 619 642 647 615 599 607 611
ORDER BY ASC using index (multi) and WHERE clause
21 SS 426 379 401 409 393 393 623 416 392 2405 2391 2399 2224 2409 2396 400 2244 2388 2413 2265 411 426 426 399 436 438 2401 420 415 426 421
ORDER BY ASC using index (multi) and WHERE clause
22 CS 622 678 642 611 617 671 620 609 587 620 644 634 625 627 644 594 624 666 633 677 626 615 597 586 615 658 875 589 589 599 594
ISQL - SHOW SYSTEM TABLES
23 SS 432 379 397 379 379 649 406 426 414 2391 2237 2245 2427 2405 2239 406 2229 2229 2425 2431 431 443 422 405 429 425 2235 524 414 433 413
ISQL - SHOW SYSTEM TABLES
24 CS 50840 49923 50777 50302 53466 50652 53271 49771 50860 50349 51281 50859 50807 50807 52753 49836 52056 50861 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754 53472
Make asynchronous replica re-initialization reliable #8324
25 SS 50409 52519 53288 52629 51278 53252 50323 50224 53644 2394 2391 2387 2395 2198 2422 53263 2391 2205 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443 49221
Make asynchronous replica re-initialization reliable #8324
26 CS 1468 1633 1425 1532 1427 1691 1452 1456 1428 1460 1456 1469 1459 1458 1560 1434 1455 1484 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467 1430
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
27 SS 1243 983 1009 998 997 1241 1432 1242 985 2224 2221 2242 2473 2448 2239 1006 2442 2425 2433 2442 1073 1313 1355 1009 1245 1059 2422 1084 1012 1229 1005
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8182
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
https://github.com/FirebirdSQL/firebird/issues/8589
https://github.com/FirebirdSQL/firebird/issues/8592
=== end of list ===

Last commits information (all timestamps in UTC):