01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (25 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
07. Has fails: tests with at least one fail for previous 30 runs (79 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (7 rows)
11. All tests: outcomes for previous 30 runs (3425 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 26.06.2025 11:48
Tested: HQ50.   Build / date: 5.0.3.1657-8b4d2d0b / 2025.06.20;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
Test TITLE
1 CS F F F F F F F F F F F P P F F F F F P P F F P F F F P P P F
Compress Data over the Network
2 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Events in system attachments (like garbage collector) are not traced
5 CS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
6 SS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
7 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
8 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
9 SS F F F F F F F E E E E E E F E E E E F F F F F F F F F F X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 CS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
PERCENT_RANK may return NaN instead of 0
11 SS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
PERCENT_RANK may return NaN instead of 0
12 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
13 SS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
14 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
15 SS F F F F F F F E E E E E E F E E E E F F F F F F E F F F F F
ORDER BY ASC using index (multi)
16 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
17 SS F F F F F F F E E E E E E F E E E E F F F F F F E F F F F F
ORDER BY ASC using index (multi)
18 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
19 SS F F F F F F F E E E E E E F E E E E F F F F F F E F F F F F
ORDER BY ASC using index (multi) and WHERE clause
20 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ISQL - SHOW SYSTEM TABLES
21 SS F F F F F F F E E E E E E F E E E E F F F F F F E F F F F F
ISQL - SHOW SYSTEM TABLES
22 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
23 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
24 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
25 SS F F F F F F F E E E E E E F E E E E F F F F F F E F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
Test TITLE
1 CS 16971 16507 16816 17075 16766 17487 16823 16519 16559 17308 16624 16966 16304 16353 16455 16787 16977 17080 17338 16997 17108 19684 17369 17187 17231 17656 16996 16698 16271 16309 18168
Compress Data over the Network
2 CS 1501 1455 1477 1461 1492 1468 1474 1451 1469 1519 1533 1506 1845 1803 1465 1476 1497 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482 1832 1518
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 1044 913 1030 1030 1014 1020 1190 1234 1433 1183 1228 826 1249 999 1239 1234 921 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956 741 1052
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS 303 287 295 522 578 530 288 292 285 302 291 331 295 302 297 298 325 318 413 325 328 291 571 326 324 295 429 301 570 304 299
Events in system attachments (like garbage collector) are not traced
5 CS 582 580 638 582 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
6 SS 394 387 394 394 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
IN predicate incorrectly handles single parenthesized subquery as IN-list, instead of table subquery
7 CS 1069 1040 1022 1026 1098 1068 1065 1032 1047 1041 1034 1033 1103 1084 1041 1063 1070 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091 1104 1088
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
8 CS 1094 1069 1100 1062 1120 1111 1066 1057 1122 1095 1093 1092 1101 1102 1109 1109 1104 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
9 SS 885 845 840 841 871 860 839 844 2390 2388 2392 2235 2405 2382 839 2402 2418 2391 2416 925 877 886 842 887 857 868 1113 870 884 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 CS 600 600 615 583 593 616 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PERCENT_RANK may return NaN instead of 0
11 SS 391 390 391 396 401 387 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PERCENT_RANK may return NaN instead of 0
12 CS 608 606 610 618 590 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
13 SS 391 390 392 393 388 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Presence of 'ROWS <n_limit>' causes garbage in error message when string conversion problem raises
14 CS 840 807 843 834 843 849 832 811 838 853 840 885 844 855 831 828 856 867 1108 840 853 833 843 849 894 828 810 831 827 818 826
ORDER BY ASC using index (multi)
15 SS 597 551 537 525 548 569 775 555 2400 2384 2398 2256 2412 2398 566 2229 2393 2401 2429 576 611 611 558 584 581 2405 682 571 569 574 560
ORDER BY ASC using index (multi)
16 CS 844 833 848 833 843 817 797 812 829 847 833 844 868 849 816 850 851 858 916 856 854 836 844 889 898 851 833 842 811 854 812
ORDER BY ASC using index (multi)
17 SS 600 542 567 548 555 529 526 549 2230 2237 2235 2395 2383 2233 562 2410 2419 2404 2436 597 609 595 559 604 570 2239 613 561 843 564 563
ORDER BY ASC using index (multi)
18 CS 629 600 631 640 662 604 598 627 643 637 621 642 623 878 632 637 649 628 716 668 629 594 629 619 642 647 615 599 607 611 607
ORDER BY ASC using index (multi) and WHERE clause
19 SS 426 401 409 393 393 623 416 392 2405 2391 2399 2224 2409 2396 400 2244 2388 2413 2265 411 426 426 399 436 438 2401 420 415 426 421 411
ORDER BY ASC using index (multi) and WHERE clause
20 CS 620 642 611 617 671 620 609 587 620 644 634 625 627 644 594 624 666 633 677 626 615 597 586 615 658 875 589 589 599 594 599
ISQL - SHOW SYSTEM TABLES
21 SS 432 397 379 379 649 406 426 414 2391 2237 2245 2427 2405 2239 406 2229 2229 2425 2431 431 443 422 405 429 425 2235 524 414 433 413 400
ISQL - SHOW SYSTEM TABLES
22 CS 50859 50777 50302 53466 50652 53271 49771 50860 50349 51281 50859 50807 50807 52753 49836 52056 50861 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754 53472 52888
Make asynchronous replica re-initialization reliable #8324
23 SS 50358 53288 52629 51278 53252 50323 50224 53644 2394 2391 2387 2395 2198 2422 53263 2391 2205 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443 49221 48625
Make asynchronous replica re-initialization reliable #8324
24 CS 1464 1425 1532 1427 1691 1452 1456 1428 1460 1456 1469 1459 1458 1560 1434 1455 1484 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467 1430 1445
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
25 SS 1243 1009 998 997 1241 1432 1242 985 2224 2221 2242 2473 2448 2239 1006 2442 2425 2433 2442 1073 1313 1355 1009 1245 1059 2422 1084 1012 1229 1005 1004
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8182
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
https://github.com/FirebirdSQL/firebird/issues/8589
https://github.com/FirebirdSQL/firebird/issues/8592
=== end of list ===

Last commits information (all timestamps in UTC):