01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (22 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (111 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2632 rows)
12. Skipped: tests which was intentionally excluded from execution (82 rows)

Generated UTC 24.04.2025 12:25
Tested: HQ50.   Build / date: 5.0.3.1649-5b2d0dcc / 2025.04.21;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F P P P
Compress Data over the Network
2 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F P P P
Compress Data over the Network
3 CS F F F F F F F F F F F F F F P P P P P P P P P P P P P P P P
GSec incorrectly processes some switches
4 SS F F F F F F F F F F F F F F P P P P P P P P P P P P P P P P
GSec incorrectly processes some switches
5 CS F F F F F F F F F F F F F F F F F P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F F F F F F F F F F F F F P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS F F F F F F F F F F F F F F F F F F X X X X X X X X X X X X
Events in system attachments (like garbage collector) are not traced
8 CS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 CS F F F F F F F F F F F F X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 SS F F F F F F F F F F F F X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
12 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
13 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
14 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
15 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
16 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
17 CS F F F F F F F F F F F F F F P P P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
18 SS F F F F F F F F F F F F F F P P P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
19 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
20 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
21 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
Test TITLE
1 CS 779 36744 33362 39272 33374 39827 36894 857 893 831 776 804 843 625 582 665 580 590 582 688 678 603 661 682 1292 1280 783 892 542 492 519
Compress Data over the Network
2 SS 443 35501 32253 35410 32196 34778 34557 453 462 453 449 464 438 319 334 369 340 326 355 345 372 344 343 388 450 694 466 528 354 313 342
Compress Data over the Network
3 CS 746 589 607 625 624 527 599 1023 1049 902 964 958 947 803 703 749 744 687 693 729 721 767 751 754 1391 1350 912 940 666 627 674
GSec incorrectly processes some switches
4 SS 416 371 407 382 356 382 384 544 540 539 520 508 554 401 384 410 400 403 443 422 405 426 437 437 597 1425 581 585 367 403 354
GSec incorrectly processes some switches
5 CS 768 2252 2122 2184 1972 2001 2135 803 1203 775 830 762 798 589 656 605 593 601 575 680 680 605 714 668 1219 1102 799 802 504 501 503
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 398 1228 1104 1220 1160 1164 1260 469 434 402 395 416 433 325 311 321 306 333 337 328 366 312 343 348 590 710 493 450 273 294 288
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS 1072 366 320 394 345 391 354 1532 1488 1608 1188 1358 1600 1035 1054 1078 1137 1067 1161 0 0 0 0 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
8 CS 1167 1835 1864 2005 1865 2058 2154 1295 1170 1164 1288 1388 1249 934 925 1025 932 969 961 925 925 929 996 0 0 0 0 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 CS 376 789 744 920 727 751 776 26 15 15 14 11 19 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 SS 8595 441 391 441 373 595 424 17443 17909 17138 17208 16855 16595 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 CS 783 1019 1041 1017 1013 991 965 858 959 846 781 785 931 617 652 614 695 642 624 627 653 674 701 663 1170 1442 865 787 537 583 501
ORDER BY ASC using index (multi)
12 SS 435 641 591 594 575 744 615 553 481 527 439 498 432 352 350 357 306 365 337 374 377 379 370 385 540 732 477 488 317 315 325
ORDER BY ASC using index (multi)
13 CS 917 1071 1094 1078 1082 901 1184 1072 1027 1050 933 989 1015 750 726 799 745 725 746 758 764 801 788 760 1594 1440 977 1010 732 657 739
ORDER BY ASC using index (multi)
14 SS 521 505 585 560 560 750 774 552 570 549 537 600 563 447 425 452 419 453 435 408 497 471 434 433 659 897 564 585 403 439 444
ORDER BY ASC using index (multi)
15 CS 7 862 829 817 839 808 774 9 10 8 5 7 8 7 4 6 7 5 7 12 9 6 6 7 19 12 5 7 7 6 6
ORDER BY ASC using index (multi) and WHERE clause
16 SS 8 436 471 533 405 667 433 9 10 7 8 8 9 6 7 6 5 7 5 7 5 7 6 6 14 12 10 7 9 6 8
ORDER BY ASC using index (multi) and WHERE clause
17 CS 730 837 847 797 841 737 772 868 780 794 782 724 800 592 572 655 567 499 581 630 588 618 628 611 924 1257 780 770 529 479 495
ISQL - SHOW SYSTEM TABLES
18 SS 399 401 429 421 444 505 400 497 427 399 434 414 434 305 316 373 320 316 332 351 364 340 305 314 549 622 440 428 287 303 292
ISQL - SHOW SYSTEM TABLES
19 CS 36477 50507 53171 47749 50475 50360 50470 34906 37174 34965 32370 34664 35780 27040 27677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
20 SS 34913 52864 50843 50694 50997 46826 50510 34671 35156 31666 32251 31753 31808 23582 26433 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
21 CS 178907 1701 1776 1885 1846 1794 1717 405388 431273 362977 365115 354287 317811 178556 176816 180575 171808 181481 194450 192180 193229 194275 193538 194428 179258 4586 3096 3049 2758 2963 2771
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 SS 179329 1093 1170 1182 1086 1373 1032 411086 179039 364065 360746 362390 331814 179619 176212 181790 175699 182188 192466 188410 194723 194220 195183 192151 180579 3465 2251 2241 2020 2002 2069
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1263
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):