01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (28 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (25 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (39 rows)
07. Has fails: tests with at least one fail for previous 30 runs (102 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2606 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 22.02.2025 11:46
Tested: HQ50.   Build / date: 5.0.2.1615-4a72664d / 2025.02.20;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.11
X X X X X X
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F P P P P P P X X X X X X
Compress Data over the Network
2 SS F F F F F F F F F F F F F F F F F F P P P P P P X X X X X X
Compress Data over the Network
3 CS F F F F F P P P P P P P P P P P P P P P P P P P X X X X X X
GSec incorrectly processes some switches
4 SS F F F F F P P P P P P P P P P P P P P P P P P P X X X X X X
GSec incorrectly processes some switches
5 CS F F F F F F F F P P P P P P P P P P P P P P P P X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F F F F P P P P P P P P P P P P P P P P X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS F F P P P P P P P P P P P P P P P P P P P P P P X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
8 SS F F P P P P P P P P P P P P P P P P P P P P P P X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
9 CS F F P P P P P P P P P P P P P P X X X X X X X X X X X X X X
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
10 SS F F P P P P P P P P P P P P P P X X X X X X X X X X X X X X
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
11 SS F F F F F F F F F X X X X X X X X X X X X X X X X X X X X X
Events in system attachments (like garbage collector) are not traced
12 CS F F P P P P P P P P P P P P P P P P P P P P P P X X X X X X
Memory leak when executing a lot of different queries and StatementTimeout > 0
13 SS F F P P P P P P P P P P P P P P P P P P P P P P X X X X X X
Memory leak when executing a lot of different queries and StatementTimeout > 0
14 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
15 CS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
16 SS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
17 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi)
18 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi)
19 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi)
20 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi)
21 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
22 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
23 CS F F F F F P P P P P P P P P P P P P P P P P P P X X X X X X
ISQL - SHOW SYSTEM TABLES
24 SS F F F F F P P P P P P P P P P P P P P P P P P P X X X X X X
ISQL - SHOW SYSTEM TABLES
25 CS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
26 SS F F F F F X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
27 CS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
28 SS F F F F F F F F F F F F F F F F F F F F F F F F X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.08
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.11
X X X X X X
Test TITLE
1 CS 643 882 804 843 625 582 665 580 590 582 688 678 603 661 682 1292 1280 783 892 542 492 519 557 525 583 0 0 0 0 0 0
Compress Data over the Network
2 SS 349 487 464 438 319 334 369 340 326 355 345 372 344 343 388 450 694 466 528 354 313 342 282 294 304 0 0 0 0 0 0
Compress Data over the Network
3 CS 746 979 958 947 803 703 749 744 687 693 729 721 767 751 754 1391 1350 912 940 666 627 674 720 653 621 0 0 0 0 0 0
GSec incorrectly processes some switches
4 SS 417 591 508 554 401 384 410 400 403 443 422 405 426 437 437 597 1425 581 585 367 403 354 363 413 338 0 0 0 0 0 0
GSec incorrectly processes some switches
5 CS 630 772 762 798 589 656 605 593 601 575 680 680 605 714 668 1219 1102 799 802 504 501 503 474 476 486 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 330 457 416 433 325 311 321 306 333 337 328 366 312 343 348 590 710 493 450 273 294 288 298 277 281 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS 599 760 688 798 519 502 547 516 528 568 526 563 560 666 630 800 1239 699 653 421 416 423 41310 41010 36282 0 0 0 0 0 0
Slow performance when executing SQL scripts as non-SYSDBA user
8 SS 273 426 372 388 252 235 238 235 277 260 270 242 279 250 248 450 591 286 430 166 155 244 40408 42395 35941 0 0 0 0 0 0
Slow performance when executing SQL scripts as non-SYSDBA user
9 CS 3042 4121 3753 3907 2886 2921 3057 2919 2944 2877 2950 2995 3027 3255 3132 4483 5402 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
10 SS 2182 2780 2661 2686 2084 2041 2166 1975 2077 2066 2018 2218 2199 2117 2209 3155 4492 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Memory leak when running EXECUTE STATEMENT with named parameters [CORE6475]
11 SS 1137 1569 1358 1600 1035 1054 1078 1137 1067 1161 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
12 CS 618 843 772 758 618 580 622 587 584 658 597 629 604 638 619 1251 1473 830 847 546 524 573 504 543 501 0 0 0 0 0 0
Memory leak when executing a lot of different queries and StatementTimeout > 0
13 SS 352 488 424 415 326 322 341 332 365 330 352 352 439 352 384 572 740 409 496 308 306 358 275 331 263 0 0 0 0 0 0
Memory leak when executing a lot of different queries and StatementTimeout > 0
14 CS 961 1278 1388 1249 934 925 1025 932 969 961 925 925 929 996 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
15 CS 11 11 11 19 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
16 SS 16855 18533 16855 16595 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
17 CS 652 879 785 931 617 652 614 695 642 624 627 653 674 701 663 1170 1442 865 787 537 583 501 515 552 516 0 0 0 0 0 0
ORDER BY ASC using index (multi)
18 SS 367 467 498 432 352 350 357 306 365 337 374 377 379 370 385 540 732 477 488 317 315 325 359 345 314 0 0 0 0 0 0
ORDER BY ASC using index (multi)
19 CS 759 1025 989 1015 750 726 799 745 725 746 758 764 801 788 760 1594 1440 977 1010 732 657 739 649 745 618 0 0 0 0 0 0
ORDER BY ASC using index (multi)
20 SS 445 664 600 563 447 425 452 419 453 435 408 497 471 434 433 659 897 564 585 403 439 444 415 419 428 0 0 0 0 0 0
ORDER BY ASC using index (multi)
21 CS 7 10 7 8 7 4 6 7 5 7 12 9 6 6 7 19 12 5 7 7 6 6 8 9 11 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
22 SS 7 8 8 9 6 7 6 5 7 5 7 5 7 6 6 14 12 10 7 9 6 8 9 6 8 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
23 CS 601 817 724 800 592 572 655 567 499 581 630 588 618 628 611 924 1257 780 770 529 479 495 481 540 479 0 0 0 0 0 0
ISQL - SHOW SYSTEM TABLES
24 SS 326 434 414 434 305 316 373 320 316 332 351 364 340 305 314 549 622 440 428 287 303 292 294 262 277 0 0 0 0 0 0
ISQL - SHOW SYSTEM TABLES
25 CS 34664 36628 34664 35780 27040 27677 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
26 SS 31753 35238 31753 31808 23582 26433 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
27 CS 178907 407553 354287 317811 178556 176816 180575 171808 181481 194450 192180 193229 194275 193538 194428 179258 4586 3096 3049 2758 2963 2771 531 519 460 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
28 SS 180099 435147 362390 331814 179619 176212 181790 175699 182188 192466 188410 194723 194220 195183 192151 180579 3465 2251 2241 2020 2002 2069 320 265 302 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1263
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/6220
https://github.com/FirebirdSQL/firebird/issues/6706
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8085
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):