01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (10 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (125 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (704 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (3202 rows)
12. Skipped: tests which was intentionally excluded from execution (67 rows)

Generated UTC 20.11.2024 11:29
Tested: HQ40.   Build / date: 4.0.6.3163-832dbff1 / 2024.10.30;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.05
4.0.5.3049
2024.01.04
4.0.5.3049
2024.01.04
4.0.5.3049
2024.01.04
4.0.5.3034
2023.12.12
4.0.5.3034
2023.12.12
Test TITLE
1 CS F F F F F F F P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
2 SS F F F F F F F P P P P P P P P P P P P P P P P P P P P P P P
Compress Data over the Network
3 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Backup error for wide table
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Backup error for wide table
5 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
6 SS F F E F E F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
7 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
8 SS F F E F E F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
10 SS F F E F E F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3163
2024.10.30
4.0.6.3163
2024.10.16
4.0.6.3147
2024.09.10
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.08.06
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.20
4.0.5.3083
2024.04.06
4.0.5.3052
2024.03.16
4.0.5.3052
2024.03.16
4.0.5.3052
2024.02.12
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.07
4.0.5.3052
2024.02.02
4.0.5.3052
2024.01.26
4.0.5.3052
2024.01.26
4.0.5.3049
2024.01.25
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.08
4.0.5.3049
2024.01.05
4.0.5.3049
2024.01.04
4.0.5.3049
2024.01.04
4.0.5.3049
2024.01.04
4.0.5.3034
2023.12.12
4.0.5.3034
2023.12.12
Test TITLE
1 CS 23783 16683 17286 17093 17817 17150 17139 17481 25055 25163 23971 24440 24237 24206 24019 23861 23767 23814 23798 23829 23751 23736 23703 24783 24721 24704 23720 23736 23768 23860 23610
Compress Data over the Network
2 SS 23037 16103 16520 16403 16647 18322 16505 16512 24459 23232 23549 23830 23409 23503 23128 23053 23022 23083 23115 23052 22959 22990 22990 23361 23283 23252 23007 23021 23112 22944 22943
Compress Data over the Network
3 CS 859 1048 911 937 1068 1175 1255 998 848 985 719 719 953 954 718 687 671 858 859 843 843 859 858 1030 1014 1030 842 843 843 843 859
Backup error for wide table
4 SS 624 621 624 618 609 937 946 913 633 581 438 437 437 672 406 437 405 624 624 624 640 624 624 655 687 655 624 624 624 624 734
Backup error for wide table
5 CS 686 838 918 851 956 926 1041 1027 834 824 626 687 641 640 625 562 562 562 577 577 671 687 687 734 749 749 686 577 671 578 578
ORDER BY ASC using index (multi)
6 SS 421 581 580 2391 574 2244 610 621 525 489 390 391 375 375 360 358 359 453 359 453 468 421 421 452 390 452 421 421 421 358 358
ORDER BY ASC using index (multi)
7 CS 656 831 841 843 932 939 1047 1022 804 818 656 641 1625 656 641 561 562 578 655 687 562 562 578 749 734 749 562 578 562 578 562
ORDER BY ASC using index (multi)
8 SS 382 569 575 2235 574 2414 618 620 516 489 391 391 375 391 359 358 359 358 359 358 359 359 358 390 390 390 358 358 358 358 358
ORDER BY ASC using index (multi)
9 CS 453 621 663 636 688 740 771 745 515 557 469 453 454 453 453 406 390 406 389 405 406 405 389 546 546 546 389 421 406 406 405
ORDER BY ASC using index (multi) and WHERE clause
10 SS 250 425 426 2230 433 2407 471 478 422 348 265 250 266 250 235 234 233 233 233 233 233 233 234 280 264 265 233 234 234 233 234
ORDER BY ASC using index (multi) and WHERE clause

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird/issues/7436
=== end of list ===

Last commits information (all timestamps in UTC):