01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (10 rows)
06. Has fails: tests with at least one fail for previous 30 runs (160 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
10. All tests: outcomes for previous 30 runs (2487 rows)
11. All tests: durations for previous 30 runs (4798 rows)
12. Skipped: tests which was intentionally excluded from execution (71 rows)

Generated 14.06.2024 12:56
Tested: HQ40.   Build: 4.0.5.3109;   SS: 14.06.24 11:14:56 - 14.06.24 11:58:42;   CS: 14.06.24 11:59:27 - 14.06.24 12:54:59;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 4.0.5.3109
2024-06-14		 4.0.5.3097
2024-06-10		 4.0.5.3091
2024-05-08		 4.0.5.3089
2024-04-27		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-06		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-30		 4.0.4.3013
2023-11-30		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-15		 4.0.3.2955
2023-08-11		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-25		 4.0.3.2931
2023-04-30		 4.0.3.2920
2023-04-21		 4.0.3.2913
2023-04-02		 4.0.3.2908
2023-03-22		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-09		 4.0.3.2885
2023-01-27		 X X X X X X X X X
Test TITLE
1
bugs gh 4723 incompressible 
 tracker
 CS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
2
bugs gh 4723 incompressible 
 tracker
 SS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
3
bugs gh 7436 
 tracker
 CS F F F F F F F X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
4
bugs gh 7436 
 tracker
 SS F F F F F F F X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
5
functional arno optimizer opt sort by index 10 
 CS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 10 
 SS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 13 
 CS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi)
8
functional arno optimizer opt sort by index 13 
 SS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi)
9
functional arno optimizer opt sort by index 19 
 CS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
10
functional arno optimizer opt sort by index 19 
 SS F F F F F F F F F F F F F F F F F F F F F X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3109
2024-06-14		 4.0.5.3097
2024-06-10		 4.0.5.3091
2024-05-08		 4.0.5.3089
2024-04-27		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-06		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-30		 4.0.4.3013
2023-11-30		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-15		 4.0.3.2955
2023-08-11		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-25		 4.0.3.2931
2023-04-30		 4.0.3.2920
2023-04-21		 4.0.3.2913
2023-04-02		 4.0.3.2908
2023-03-22		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-09		 4.0.3.2885
2023-01-27		 X X X X X X X X X
Test TITLE
1
bugs gh 4723 incompressible 
 tracker
 CS 2259 1847 2671 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
2
bugs gh 4723 incompressible 
 tracker
 SS 1544 1386 1703 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
3
bugs gh 7436 
 tracker
 CS 1205 1075 1003 838 1423 1205 1247 1484 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
4
bugs gh 7436 
 tracker
 SS 891 573 574 886 1139 891 910 1298 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
5
functional arno optimizer opt sort by index 10 
 CS 823 795 791 790 829 846 804 807 801 773 775 828 738 822 823 864 867 835 833 835 932 934 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 10 
 SS 495 492 487 489 485 495 484 500 494 490 542 467 497 499 496 506 511 478 509 512 572 447 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 13 
 CS 824 944 799 834 824 827 809 856 804 762 796 702 750 781 838 829 843 843 822 818 932 900 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
8
functional arno optimizer opt sort by index 13 
 SS 495 485 471 480 485 489 503 495 495 511 532 467 509 495 509 508 510 516 513 490 577 446 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
9
functional arno optimizer opt sort by index 19 
 CS 542 501 496 553 547 548 495 584 517 493 565 499 490 563 513 542 597 522 605 520 658 736 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
10
functional arno optimizer opt sort by index 19 
 SS 345 340 326 336 345 329 339 360 338 362 355 327 336 335 351 359 348 366 348 354 429 337 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/7436

=== end of list ===