01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (22 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (104 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (21 rows)
11. All tests: outcomes for previous 30 runs (2650 rows)
12. Skipped: tests which was intentionally excluded from execution (85 rows)

Generated UTC 07.06.2025 06:54
Tested: HQ50.   Build / date: 5.0.3.1656-c4b11bd4 / 2025.05.20;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Compress Data over the Network
2 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Compress Data over the Network
3 CS F F F F F F F F F F F F F F F F F F P P P P P P P P P P P P
GSec incorrectly processes some switches
4 SS F F F F F F F F F F F F F F F F F F P P P P P P P P P P P P
GSec incorrectly processes some switches
5 CS F F F F F F F F F F F F F F F F F F F F F P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F F F F F F F F F F F F F F F F F P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
Events in system attachments (like garbage collector) are not traced
8 CS F F F F F F F F F F F F F F F F F F F F F F F F F F X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 CS F F F F F F F F F F F F F F F F X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 SS F F F F F F F F F F F F F F F F X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
12 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
13 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
14 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
15 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
16 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
17 CS F F F F F F F F F F F F F F F F F F P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
18 SS F F F F F F F F F F F F F F F F F F P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
19 CS F F F F F F F F F F F F F F F F F F X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
20 SS F F F F F F F F F F F F F F F F F F X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
21 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1656
2025.05.20
5.0.3.1652
2025.05.13
5.0.3.1651
2025.04.30
5.0.3.1650
2025.04.28
5.0.3.1649
2025.04.21
5.0.3.1648
2025.04.18
5.0.3.1635
2025.03.31
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.21
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
Test TITLE
1 CS 837 36483 36825 39906 40243 37666 33362 39272 33374 39827 36894 857 893 831 776 804 843 625 582 665 580 590 582 688 678 603 661 682 1292 1280 783
Compress Data over the Network
2 SS 453 35244 34884 38268 38790 35390 32253 35410 32196 34778 34557 453 462 453 449 464 438 319 334 369 340 326 355 345 372 344 343 388 450 694 466
Compress Data over the Network
3 CS 736 560 559 657 665 665 607 625 624 527 599 1023 1049 902 964 958 947 803 703 749 744 687 693 729 721 767 751 754 1391 1350 912
GSec incorrectly processes some switches
4 SS 417 404 412 422 373 371 407 382 356 382 384 544 540 539 520 508 554 401 384 410 400 403 443 422 405 426 437 437 597 1425 581
GSec incorrectly processes some switches
5 CS 801 2185 2247 2194 2469 2162 2122 2184 1972 2001 2135 803 1203 775 830 762 798 589 656 605 593 601 575 680 680 605 714 668 1219 1102 799
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 433 1257 1389 1324 1359 1361 1104 1220 1160 1164 1260 469 434 402 395 416 433 325 311 321 306 333 337 328 366 312 343 348 590 710 493
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 SS 1044 382 378 394 386 380 320 394 345 391 354 1532 1488 1608 1188 1358 1600 1035 1054 1078 1137 1067 1161 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
8 CS 1268 2076 2032 1987 1935 1966 1864 2005 1865 2058 2154 1295 1170 1164 1288 1388 1249 934 925 1025 932 969 961 925 925 929 996 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 CS 747 804 871 817 847 842 744 920 727 751 776 26 15 15 14 11 19 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
10 SS 470 469 471 469 424 408 391 441 373 595 424 17443 17909 17138 17208 16855 16595 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
11 CS 861 1017 1043 1010 987 972 1041 1017 1013 991 965 858 959 846 781 785 931 617 652 614 695 642 624 627 653 674 701 663 1170 1442 865
ORDER BY ASC using index (multi)
12 SS 489 572 604 567 601 552 591 594 575 744 615 553 481 527 439 498 432 352 350 357 306 365 337 374 377 379 370 385 540 732 477
ORDER BY ASC using index (multi)
13 CS 983 990 1046 1024 1098 976 1094 1078 1082 901 1184 1072 1027 1050 933 989 1015 750 726 799 745 725 746 758 764 801 788 760 1594 1440 977
ORDER BY ASC using index (multi)
14 SS 560 600 568 591 630 579 585 560 560 750 774 552 570 549 537 600 563 447 425 452 419 453 435 408 497 471 434 433 659 897 564
ORDER BY ASC using index (multi)
15 CS 9 792 801 853 822 745 829 817 839 808 774 9 10 8 5 7 8 7 4 6 7 5 7 12 9 6 6 7 19 12 5
ORDER BY ASC using index (multi) and WHERE clause
16 SS 9 421 522 492 453 509 471 533 405 667 433 9 10 7 8 8 9 6 7 6 5 7 5 7 5 7 6 6 14 12 10
ORDER BY ASC using index (multi) and WHERE clause
17 CS 780 817 780 842 838 811 847 797 841 737 772 868 780 794 782 724 800 592 572 655 567 499 581 630 588 618 628 611 924 1257 780
ISQL - SHOW SYSTEM TABLES
18 SS 417 428 438 395 439 441 429 421 444 505 400 497 427 399 434 414 434 305 316 373 320 316 332 351 364 340 305 314 549 622 440
ISQL - SHOW SYSTEM TABLES
19 CS 49054 50470 52611 56165 53054 50745 53171 47749 50475 50360 50470 34906 37174 34965 32370 34664 35780 27040 27677 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
20 SS 46721 56808 49956 46617 50551 50553 50843 50694 50997 46826 50510 34671 35156 31666 32251 31753 31808 23582 26433 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
21 CS 178907 1760 1802 1830 1807 1596 1776 1885 1846 1794 1717 405388 431273 362977 365115 354287 317811 178556 176816 180575 171808 181481 194450 192180 193229 194275 193538 194428 179258 4586 3096
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 SS 179329 1161 1093 1183 1071 1080 1170 1182 1086 1373 1032 411086 179039 364065 360746 362390 331814 179619 176212 181790 175699 182188 192466 188410 194723 194220 195183 192151 180579 3465 2251
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1263
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):