01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (20 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (4 rows)
07. Has fails: tests with at least one fail for previous 30 runs (77 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (7 rows)
11. All tests: outcomes for previous 30 runs (3424 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 28.06.2025 11:37
Tested: HQ50.   Build / date: 5.0.3.1674-3ee5cc1f / 2025.06.27;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1674
2025.06.27
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
Test TITLE
1 CS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Events in system attachments (like garbage collector) are not traced
6 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
7 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Crash when creating index on table that uses UDR and ParallelWorkers > 1
8 SS F F F F F F F F F E E E E E E F E E E E F F F F F F F F F F
Crash when creating index on table that uses UDR and ParallelWorkers > 1
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
10 SS F F F F F F F F F E E E E E E F E E E E F F F F F F E F F F
ORDER BY ASC using index (multi)
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
12 SS F F F F F F F F F E E E E E E F E E E E F F F F F F E F F F
ORDER BY ASC using index (multi)
13 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
14 SS F F F F F F F F F E E E E E E F E E E E F F F F F F E F F F
ORDER BY ASC using index (multi) and WHERE clause
15 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ISQL - SHOW SYSTEM TABLES
16 SS F F F F F F F F F E E E E E E F E E E E F F F F F F E F F F
ISQL - SHOW SYSTEM TABLES
17 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
18 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Make asynchronous replica re-initialization reliable #8324
19 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
20 SS F F F F F F F F F E E E E E E F E E E E F F F F F F E F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1674
2025.06.27
5.0.3.1657
2025.06.26
5.0.3.1657
2025.06.20
5.0.3.1657
2025.06.19
5.0.3.1657
2025.06.11
5.0.3.1657
2025.06.10
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
Test TITLE
1 CS 679 1020 1021 1038 664 693 681 666 662 661 667 710 660 683 655 666 736 658 661 668 691 673 673 1041 695 685 727 689 684 672 677
CREATE VIEW ignores PLAN
2 SS 460 824 827 787 445 440 487 433 441 439 441 463 454 452 444 469 458 439 449 454 469 492 476 474 455 564 477 493 455 480 468
CREATE VIEW ignores PLAN
3 CS 1487 1464 1460 1455 1477 1461 1492 1468 1474 1451 1469 1519 1533 1506 1845 1803 1465 1476 1497 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS 1034 875 959 913 1030 1030 1014 1020 1190 1234 1433 1183 1228 826 1249 999 1239 1234 921 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 SS 302 299 293 287 295 522 578 530 288 292 285 302 291 331 295 302 297 298 325 318 413 325 328 291 571 326 324 295 429 301 570
Events in system attachments (like garbage collector) are not traced
6 CS 1066 1036 1050 1040 1022 1026 1098 1068 1065 1032 1047 1041 1034 1033 1103 1084 1041 1063 1070 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
7 CS 1094 1154 1074 1069 1100 1062 1120 1111 1066 1057 1122 1095 1093 1092 1101 1102 1109 1109 1104 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133
Crash when creating index on table that uses UDR and ParallelWorkers > 1
8 SS 880 871 851 845 840 841 871 860 839 844 2390 2388 2392 2235 2405 2382 839 2402 2418 2391 2416 925 877 886 842 887 857 868 1113 870 884
Crash when creating index on table that uses UDR and ParallelWorkers > 1
9 CS 843 859 852 807 843 834 843 849 832 811 838 853 840 885 844 855 831 828 856 867 1108 840 853 833 843 849 894 828 810 831 827
ORDER BY ASC using index (multi)
10 SS 597 518 535 551 537 525 548 569 775 555 2400 2384 2398 2256 2412 2398 566 2229 2393 2401 2429 576 611 611 558 584 581 2405 682 571 569
ORDER BY ASC using index (multi)
11 CS 844 845 851 833 848 833 843 817 797 812 829 847 833 844 868 849 816 850 851 858 916 856 854 836 844 889 898 851 833 842 811
ORDER BY ASC using index (multi)
12 SS 600 523 531 542 567 548 555 529 526 549 2230 2237 2235 2395 2383 2233 562 2410 2419 2404 2436 597 609 595 559 604 570 2239 613 561 843
ORDER BY ASC using index (multi)
13 CS 630 602 655 600 631 640 662 604 598 627 643 637 621 642 623 878 632 637 649 628 716 668 629 594 629 619 642 647 615 599 607
ORDER BY ASC using index (multi) and WHERE clause
14 SS 426 388 379 401 409 393 393 623 416 392 2405 2391 2399 2224 2409 2396 400 2244 2388 2413 2265 411 426 426 399 436 438 2401 420 415 426
ORDER BY ASC using index (multi) and WHERE clause
15 CS 622 616 678 642 611 617 671 620 609 587 620 644 634 625 627 644 594 624 666 633 677 626 615 597 586 615 658 875 589 589 599
ISQL - SHOW SYSTEM TABLES
16 SS 432 380 379 397 379 379 649 406 426 414 2391 2237 2245 2427 2405 2239 406 2229 2229 2425 2431 431 443 422 405 429 425 2235 524 414 433
ISQL - SHOW SYSTEM TABLES
17 CS 50814 49833 49923 50777 50302 53466 50652 53271 49771 50860 50349 51281 50859 50807 50807 52753 49836 52056 50861 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754
Make asynchronous replica re-initialization reliable #8324
18 SS 50409 50253 52519 53288 52629 51278 53252 50323 50224 53644 2394 2391 2387 2395 2198 2422 53263 2391 2205 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443
Make asynchronous replica re-initialization reliable #8324
19 CS 1468 1465 1633 1425 1532 1427 1691 1452 1456 1428 1460 1456 1469 1459 1458 1560 1434 1455 1484 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
20 SS 1243 998 983 1009 998 997 1241 1432 1242 985 2224 2221 2242 2473 2448 2239 1006 2442 2425 2433 2442 1073 1313 1355 1009 1245 1059 2422 1084 1012 1229
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-5501
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):