01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (23 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (10 rows)
07. Has fails: tests with at least one fail for previous 30 runs (136 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1090 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (3696 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 22.02.2025 08:33
Tested: HQ50.   Build / date: 5.0.2.1615-4a72664d / 2025.02.20;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.12
5.0.1.1415
2024.06.11
Test TITLE
1 CS F F P P P F F F F F P F F P P P F F P F F F F P P P P P P P
Compress Data over the Network
2 CS F F F F F F F F F F F F F P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F F F F F P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 CS F F P P P P P P P P P P P P P P P P P P X X X X X X X X X X
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
5 SS F F P P P P P P P P P P E P P P P P P P X X X X X X X X X X
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
6 SS F F F F F F F F F F F F E F X X X X X X X X X X X X X X X X
Events in system attachments (like garbage collector) are not traced
7 CS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Memory leak when executing a lot of different queries and StatementTimeout > 0
8 SS F F P P P P P P P P P P E P P P P P P P P P P P P P P P P P
Memory leak when executing a lot of different queries and StatementTimeout > 0
9 CS F F F F F F F F F F F F F F F F F F X X X X X X X X X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
13 SS F F F F F F F F F F F F E F F F F F E E F F F F F F F F F F
ORDER BY ASC using index (multi)
14 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
15 SS F F F F F F F F F F F F E F F F F F E E F F F F F F F F F F
ORDER BY ASC using index (multi)
16 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
17 SS F F F F F F F F F F F F E F F F F F E E F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
18 CS F F F F F F F F F F P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
19 SS F F F F F F F F F F P P E P P P P P E E P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
20 CS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
21 SS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
22 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
23 SS F F F F F F F F F F F F E F F F F F E E F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.12
5.0.1.1415
2024.06.11
Test TITLE
1 CS 16943 16422 16996 16698 16271 16309 18168 16591 16359 16553 16017 16161 16695 16836 17062 16205 16373 17010 18835 16089 16945 16942 17143 17261 24395 24688 24309 24176 23396 23549 23799
Compress Data over the Network
2 CS 2612 1380 1354 1474 1482 1832 1518 1260 1350 1445 1253 1833 1471 1468 2706 2708 2710 2728 2691 2720 2777 2782 2802 3163 2702 2676 2649 2674 2576 2574 7329
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 1824 743 1073 743 956 741 1052 660 732 749 662 1067 1063 1071 1898 1940 1913 1922 1908 1921 1950 1935 1948 1974 1824 1834 1830 1825 1823 1829 6391
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 CS 17828 18395 18221 17644 17945 18416 17954 17833 17984 17644 17862 25910 17823 17805 17789 17864 17586 17417 17688 17562 17737 0 0 0 0 0 0 0 0 0 0
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
5 SS 17807 18226 18300 17653 17881 18391 18331 17789 17586 17862 17491 17763 17902 2252 18058 17826 17551 17336 17912 17507 17654 0 0 0 0 0 0 0 0 0 0
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
6 SS 302 299 429 301 570 304 299 239 482 243 470 298 313 2384 301 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
7 CS 18526 18938 18956 18538 18535 18523 18559 18462 18526 18492 18467 18525 18527 18532 18526 18534 18535 18534 18573 18523 18600 18620 18634 18438 18438 18429 18437 18466 18435 18438 18362
Memory leak when executing a lot of different queries and StatementTimeout > 0
8 SS 18285 18791 18783 18283 18287 18294 18287 18239 18231 18249 18228 18287 18298 2428 18286 18301 18295 18287 18287 18284 18340 18342 18331 18206 18217 18211 18212 18207 18224 18215 18143
Memory leak when executing a lot of different queries and StatementTimeout > 0
9 CS 1093 1094 1072 1092 1091 1104 1088 984 1102 3251 973 1060 1059 1311 1087 1427 1427 1099 1094 0 0 0 0 0 0 0 0 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
10 CS 1091 1084 1089 1094 1133 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 SS 877 861 1113 870 884 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
12 CS 826 838 810 831 827 818 826 749 807 858 742 819 826 868 825 835 859 855 853 870 948 979 1030 807 1098 768 767 784 791 787 594
ORDER BY ASC using index (multi)
13 SS 577 581 682 571 569 574 560 482 722 508 489 569 564 2234 565 960 870 982 876 2237 2414 944 929 1274 821 717 486 481 483 491 359
ORDER BY ASC using index (multi)
14 CS 829 841 833 842 811 854 812 775 873 912 763 853 829 845 810 830 865 821 845 849 938 1004 977 808 818 789 769 785 800 775 594
ORDER BY ASC using index (multi)
15 SS 561 567 613 561 843 564 563 480 495 493 499 543 561 2418 573 583 555 563 561 2396 2240 605 593 511 489 490 482 477 490 484 359
ORDER BY ASC using index (multi)
16 CS 607 628 615 599 607 611 607 545 571 657 572 607 594 877 618 634 624 610 642 670 717 668 670 506 500 493 551 498 494 485 453
ORDER BY ASC using index (multi) and WHERE clause
17 SS 410 410 420 415 426 421 411 352 356 358 356 417 404 2402 413 404 410 420 423 2439 2422 453 454 399 324 352 336 344 326 329 234
ORDER BY ASC using index (multi) and WHERE clause
18 CS 592 591 589 589 599 594 599 573 608 642 531 613 589 623 606 611 600 613 597 583 653 655 656 481 484 481 472 479 476 474 453
ISQL - SHOW SYSTEM TABLES
19 SS 392 416 524 414 433 413 400 352 354 353 586 394 380 2250 375 391 407 390 393 2421 2396 435 436 313 299 312 313 311 302 295 234
ISQL - SHOW SYSTEM TABLES
20 CS 53180 52752 50821 53798 53754 53472 52888 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
21 SS 50888 50378 54560 51399 53443 49221 48625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
22 CS 1479 1429 1505 1478 1467 1430 1445 1328 1369 1479 1420 1445 1454 1467 1426 1480 1575 1479 1467 1736 1721 1954 1743 1577 1568 1554 1568 1492 1495 1481 1266
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
23 SS 1041 1053 1084 1012 1229 1005 1004 902 910 919 895 1027 1000 2436 1014 1077 1017 1023 1044 2469 2450 1157 1147 1206 1043 1201 1204 1031 1047 1039 797
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/6706
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8085
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):