01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (23 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (138 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1090 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (3693 rows)
12. Skipped: tests which was intentionally excluded from execution (82 rows)

Generated UTC 17.01.2025 09:39
Tested: HQ50.   Build / date: 5.0.2.1577-3c80e7c5 / 2024.12.24;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.12
5.0.1.1415
2024.06.11
5.0.1.1401
2024.06.05
5.0.1.1398
2024.05.10
5.0.1.1397
2024.05.09
Test TITLE
1 CS F F F F F F F F F F P P P P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
2 SS F F F F F F F F F F P P P P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F E F X X X X X X X X X X X X X X X X X X X
Events in system attachments (like garbage collector) are not traced
4 CS F F F F F F F F F F P P P P P P P P P P P P P P P P P P P P
Add COMPILE trace events - ability to see execution plan of every PSQL statement.
5 SS F F F F F F F F F E P P P P P P P P P P P P P P P P P P P P
Add COMPILE trace events - ability to see execution plan of every PSQL statement.
6 CS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
7 SS F F F F F F F F F E P X X X X X X X X X X X X X X X X X X X
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
8 CS F F F F F F F F F F F F F F F X X X X X X X X X X X X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 SS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Report unique usernames for isc_info_user_names
10 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
11 SS F F F F F F F F F E F F F F F E E F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
12 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
13 SS F F F F F F F F F E F F F F F E E F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
14 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
15 SS F F F F F F F F F E F F F F F E E F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
16 CS F F F F F F F P P P P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
17 SS F F F F F F F P P E P P P P P E E P P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
18 CS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
19 SS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
20 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
21 SS F F F F F F F F F E F F F F F E E F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 CS F F F F F F F F F F P P P P P P P P P P P P P P P P P P P P
Allow computable but non-invariant lists to be used for index lookup
23 SS F F F F F F F F F E P P P P P E E P P P P P P P P P P P P P
Allow computable but non-invariant lists to be used for index lookup

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.12
5.0.1.1415
2024.06.11
5.0.1.1401
2024.06.05
5.0.1.1398
2024.05.10
5.0.1.1397
2024.05.09
Test TITLE
1 CS 2683 1523 1832 1518 1260 1350 1445 1253 1833 1471 1468 2706 2708 2710 2728 2691 2720 2777 2782 2802 3163 2702 2676 2649 2674 2576 2574 7329 8017 7469 7470
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
2 SS 1832 727 741 1052 660 732 749 662 1067 1063 1071 1898 1940 1913 1922 1908 1921 1950 1935 1948 1974 1824 1834 1830 1825 1823 1829 6391 6704 6720 6641
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 302 302 304 299 239 482 243 470 298 313 2384 301 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
4 CS 3022 3006 3009 3029 2947 2960 2991 2939 2998 3005 3027 2981 2998 3001 3010 4023 3017 3078 3047 3058 3867 2938 3150 3171 3157 2927 3160 3094 3173 3095 3094
Add COMPILE trace events - ability to see execution plan of every PSQL statement.
5 SS 2526 2543 3584 2548 2498 2493 2519 2481 2548 2563 2392 2536 2540 2535 2524 2529 2547 2590 2573 2577 2462 2466 2458 2536 2468 2682 2444 2360 2360 2359 2359
Add COMPILE trace events - ability to see execution plan of every PSQL statement.
6 CS 697 758 715 702 637 933 689 640 697 704 694 687 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
7 SS 479 497 489 479 663 420 448 414 472 475 2394 480 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
SIGSEGV in Firebird 5.0.0.1306 embedded during update on cursor
8 CS 1094 1092 1104 1088 984 1102 3251 973 1060 1059 1311 1087 1427 1427 1099 1094 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
9 SS 909 904 914 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report unique usernames for isc_info_user_names
10 CS 819 819 818 826 749 807 858 742 819 826 868 825 835 859 855 853 870 948 979 1030 807 1098 768 767 784 791 787 594 641 594 594
ORDER BY ASC using index (multi)
11 SS 571 581 574 560 482 722 508 489 569 564 2234 565 960 870 982 876 2237 2414 944 929 1274 821 717 486 481 483 491 359 359 360 359
ORDER BY ASC using index (multi)
12 CS 819 830 854 812 775 873 912 763 853 829 845 810 830 865 821 845 849 938 1004 977 808 818 789 769 785 800 775 594 610 594 625
ORDER BY ASC using index (multi)
13 SS 527 573 564 563 480 495 493 499 543 561 2418 573 583 555 563 561 2396 2240 605 593 511 489 490 482 477 490 484 359 359 359 359
ORDER BY ASC using index (multi)
14 CS 600 615 611 607 545 571 657 572 607 594 877 618 634 624 610 642 670 717 668 670 506 500 493 551 498 494 485 453 453 453 453
ORDER BY ASC using index (multi) and WHERE clause
15 SS 401 407 421 411 352 356 358 356 417 404 2402 413 404 410 420 423 2439 2422 453 454 399 324 352 336 344 326 329 234 235 235 250
ORDER BY ASC using index (multi) and WHERE clause
16 CS 591 631 594 599 573 608 642 531 613 589 623 606 611 600 613 597 583 653 655 656 481 484 481 472 479 476 474 453 485 453 422
ISQL - SHOW SYSTEM TABLES
17 SS 377 419 413 400 352 354 353 586 394 380 2250 375 391 407 390 393 2421 2396 435 436 313 299 312 313 311 302 295 234 234 234 234
ISQL - SHOW SYSTEM TABLES
18 CS 52888 50755 53472 52888 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
19 SS 49221 49684 49221 48625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
20 CS 1473 1452 1430 1445 1328 1369 1479 1420 1445 1454 1467 1426 1480 1575 1479 1467 1736 1721 1954 1743 1577 1568 1554 1568 1492 1495 1481 1266 1282 1266 1219
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
21 SS 1025 1020 1005 1004 902 910 919 895 1027 1000 2436 1014 1077 1017 1023 1044 2469 2450 1157 1147 1206 1043 1201 1204 1031 1047 1039 797 797 797 797
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
22 CS 665 691 711 717 616 610 646 612 713 688 713 695 693 722 695 693 685 775 754 759 643 576 567 560 572 574 565 531 547 531 515
Allow computable but non-invariant lists to be used for index lookup
23 SS 415 452 454 455 398 380 379 379 457 471 2253 432 445 446 444 462 2436 2429 480 467 365 362 359 365 373 387 373 266 281 266 266
Allow computable but non-invariant lists to be used for index lookup

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_e260ced8.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/7466
https://github.com/FirebirdSQL/firebird/issues/8185
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8353
=== end of list ===

Last commits information (all timestamps in UTC):