01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (19 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (3 rows)
07. Has fails: tests with at least one fail for previous 30 runs (92 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (762 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (20 rows)
11. All tests: outcomes for previous 30 runs (3408 rows)
12. Skipped: tests which was intentionally excluded from execution (83 rows)

Generated UTC 06.06.2025 10:15
Tested: HQ50.   Build / date: 5.0.3.1656-00512501 / 2025.06.05;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
Test TITLE
1 CS F F F F F F F P P F F F F F P P F F P F F F P P P F F F F F
Compress Data over the Network
2 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Events in system attachments (like garbage collector) are not traced
5 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS F F F E E E E E E F E E E E F F F F F F F F F F X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
8 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
9 SS F F F E E E E E E F E E E E F F F F F F E F F F F F F F F F
ORDER BY ASC using index (multi)
10 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
11 SS F F F E E E E E E F E E E E F F F F F F E F F F F F F F F F
ORDER BY ASC using index (multi)
12 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
13 SS F F F E E E E E E F E E E E F F F F F F E F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
14 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ISQL - SHOW SYSTEM TABLES
15 SS F F F E E E E E E F E E E E F F F F F F E F F F F F F F F F
ISQL - SHOW SYSTEM TABLES
16 CS F F F F F F F F F F F F F F F F F F F F F F F F F F X X X X
Make asynchronous replica re-initialization reliable #8324
17 SS F F F F F F F F F F F F F F F F F F F F F F F F F F X X X X
Make asynchronous replica re-initialization reliable #8324
18 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
19 SS F F F E E E E E E F E E E E F F F F F F E F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1656
2025.06.05
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.05.08
5.0.3.1651
2025.05.04
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.04.03
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
Test TITLE
1 CS 16894 17582 16823 16519 16559 17308 16624 16966 16304 16353 16455 16787 16977 17080 17338 16997 17108 19684 17369 17187 17231 17656 16996 16698 16271 16309 18168 16591 16359 16553 16017
Compress Data over the Network
2 CS 1501 1464 1474 1451 1469 1519 1533 1506 1845 1803 1465 1476 1497 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482 1832 1518 1260 1350 1445 1253
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 1044 1020 1190 1234 1433 1183 1228 826 1249 999 1239 1234 921 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956 741 1052 660 732 749 662
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS 302 288 288 292 285 302 291 331 295 302 297 298 325 318 413 325 328 291 571 326 324 295 429 301 570 304 299 239 482 243 470
Events in system attachments (like garbage collector) are not traced
5 CS 1071 1043 1065 1032 1047 1041 1034 1033 1103 1084 1041 1063 1070 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091 1104 1088 984 1102 3251 973
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS 1094 1065 1066 1057 1122 1095 1093 1092 1101 1102 1109 1109 1104 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS 966 1008 839 844 2390 2388 2392 2235 2405 2382 839 2402 2418 2391 2416 925 877 886 842 887 857 868 1113 870 884 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
8 CS 838 838 832 811 838 853 840 885 844 855 831 828 856 867 1108 840 853 833 843 849 894 828 810 831 827 818 826 749 807 858 742
ORDER BY ASC using index (multi)
9 SS 611 553 775 555 2400 2384 2398 2256 2412 2398 566 2229 2393 2401 2429 576 611 611 558 584 581 2405 682 571 569 574 560 482 722 508 489
ORDER BY ASC using index (multi)
10 CS 845 832 797 812 829 847 833 844 868 849 816 850 851 858 916 856 854 836 844 889 898 851 833 842 811 854 812 775 873 912 763
ORDER BY ASC using index (multi)
11 SS 600 555 526 549 2230 2237 2235 2395 2383 2233 562 2410 2419 2404 2436 597 609 595 559 604 570 2239 613 561 843 564 563 480 495 493 499
ORDER BY ASC using index (multi)
12 CS 627 599 598 627 643 637 621 642 623 878 632 637 649 628 716 668 629 594 629 619 642 647 615 599 607 611 607 545 571 657 572
ORDER BY ASC using index (multi) and WHERE clause
13 SS 426 397 416 392 2405 2391 2399 2224 2409 2396 400 2244 2388 2413 2265 411 426 426 399 436 438 2401 420 415 426 421 411 352 356 358 356
ORDER BY ASC using index (multi) and WHERE clause
14 CS 615 583 609 587 620 644 634 625 627 644 594 624 666 633 677 626 615 597 586 615 658 875 589 589 599 594 599 573 608 642 531
ISQL - SHOW SYSTEM TABLES
15 SS 432 399 426 414 2391 2237 2245 2427 2405 2239 406 2229 2229 2425 2431 431 443 422 405 429 425 2235 524 414 433 413 400 352 354 353 586
ISQL - SHOW SYSTEM TABLES
16 CS 50860 53342 49771 50860 50349 51281 50859 50807 50807 52753 49836 52056 50861 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754 53472 52888 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
17 SS 49242 49264 50224 53644 2394 2391 2387 2395 2198 2422 53263 2391 2205 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443 49221 48625 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
18 CS 1460 1413 1456 1428 1460 1456 1469 1459 1458 1560 1434 1455 1484 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467 1430 1445 1328 1369 1479 1420
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
19 SS 1235 991 1242 985 2224 2221 2242 2473 2448 2239 1006 2442 2425 2433 2442 1073 1313 1355 1009 1245 1059 2422 1084 1012 1229 1005 1004 902 910 919 895
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):