01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (125 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (703 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (3205 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated UTC 17.01.2025 11:36
Tested: HQ40.   Build / date: 4.0.6.3169-42cc1914 / 2024.12.13;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.05
Test TITLE
1 CS F F F F F F F F F F F F P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2 SS F F F F F F F F F F F F P P P P P P P P P P P P P P P P P P
Compress Data over the Network
3 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Backup error for wide table
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Backup error for wide table
5 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
6 SS F F F F F F F E F E F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
7 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
8 SS F F F F F F F E F E F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
10 SS F F F F F F F E F E F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
11 CS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
12 SS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.12.07
4.0.6.3168
2024.12.05
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.05
Test TITLE
1 CS 23759 16808 17223 17781 17807 16753 17106 17286 17093 17817 17150 17139 17481 25055 25163 23971 24440 24237 24206 24019 23861 23767 23814 23798 23829 23751 23736 23703 24783 24721 24704
Compress Data over the Network
2 SS 23006 16674 16210 16834 16963 16596 16155 16520 16403 16647 18322 16505 16512 24459 23232 23549 23830 23409 23503 23128 23053 23022 23083 23115 23052 22959 22990 22990 23361 23283 23252
Compress Data over the Network
3 CS 945 1057 1005 1043 1053 1097 883 911 937 1068 1175 1255 998 848 985 719 719 953 954 718 687 671 858 859 843 843 859 858 1030 1014 1030
Backup error for wide table
4 SS 628 636 866 696 851 636 648 624 618 609 937 946 913 633 581 438 437 437 672 406 437 405 624 624 624 640 624 624 655 687 655
Backup error for wide table
5 CS 749 880 854 842 998 851 841 918 851 956 926 1041 1027 834 824 626 687 641 640 625 562 562 562 577 577 671 687 687 734 749 749
ORDER BY ASC using index (multi)
6 SS 460 579 598 609 822 604 583 580 2391 574 2244 610 621 525 489 390 391 375 375 360 358 359 453 359 453 468 421 421 452 390 452
ORDER BY ASC using index (multi)
7 CS 776 845 859 849 917 859 835 841 843 932 939 1047 1022 804 818 656 641 1625 656 641 561 562 578 655 687 562 562 578 749 734 749
ORDER BY ASC using index (multi)
8 SS 391 588 578 587 581 584 568 575 2235 574 2414 618 620 516 489 391 391 375 391 359 358 359 358 359 358 359 359 358 390 390 390
ORDER BY ASC using index (multi)
9 CS 546 626 621 897 860 808 633 663 636 688 740 771 745 515 557 469 453 454 453 453 406 390 406 389 405 406 405 389 546 546 546
ORDER BY ASC using index (multi) and WHERE clause
10 SS 273 440 423 448 445 417 450 426 2230 433 2407 471 478 422 348 265 250 266 250 235 234 233 233 233 233 233 233 234 280 264 265
ORDER BY ASC using index (multi) and WHERE clause
11 CS 50643 50997 50289 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
12 SS 51714 50592 52836 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird/issues/7436
=== end of list ===

Last commits information (all timestamps in UTC):