01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (162 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (7 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2470 rows)
11. All tests: durations for previous 30 runs (4737 rows)
12. Skipped: tests which was intentionally excluded from execution (86 rows)

Generated 15.05.2024 08:59
Tested: HQ40.   Build: 4.0.5.3097;   SS: 13.05.24 19:45:44 - 13.05.24 20:33:55;   CS: 15.05.24 07:51:14 - 15.05.24 08:57:50;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

NN Test name mode 4.0.5.3097
2024-05-15		 4.0.5.3091
2024-05-09		 4.0.5.3089
2024-04-29		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-04		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-29		 4.0.4.3013
2023-11-28		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-20		 4.0.3.2955
2023-08-09		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-28		 4.0.3.2931
2023-05-02		 4.0.3.2930
2023-04-21		 4.0.3.2908
2023-04-18		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-08		 4.0.3.2885
2023-01-18		 4.0.3.2884
2023-01-06		 4.0.3.2882
2023-01-06		 4.0.3.2861
2023-01-18		 X X X X X X X X
Test TITLE
1
bugs gh 7436 
 tracker
 CS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
2
bugs gh 7436 
 tracker
 SS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Backup error for wide table
3
functional arno optimizer opt sort by index 10 
 CS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi)
4
functional arno optimizer opt sort by index 10 
 SS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi)
5
functional arno optimizer opt sort by index 13 
 CS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 13 
 SS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 19 
 CS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
8
functional arno optimizer opt sort by index 19 
 SS F F F F F F F F F F F F F F F F F F F F F F X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause

Elapsed time, milliseconds:

NN Test name mode median_ms 4.0.5.3097
2024-05-15		 4.0.5.3091
2024-05-09		 4.0.5.3089
2024-04-29		 4.0.5.3083
2024-04-20		 4.0.5.3052
2024-04-04		 4.0.5.3049
2024-01-26		 4.0.5.3034
2023-12-29		 4.0.4.3013
2023-11-28		 4.0.4.2991
2023-11-09		 4.0.4.2977
2023-09-20		 4.0.3.2955
2023-08-09		 4.0.3.2943
2023-06-22		 4.0.3.2936
2023-05-28		 4.0.3.2931
2023-05-02		 4.0.3.2930
2023-04-21		 4.0.3.2908
2023-04-18		 4.0.3.2900
2023-03-14		 4.0.3.2891
2023-02-08		 4.0.3.2885
2023-01-18		 4.0.3.2884
2023-01-06		 4.0.3.2882
2023-01-06		 4.0.3.2861
2023-01-18		 X X X X X X X X
Test TITLE
1
bugs gh 7436 
 tracker
 CS 923 1146 897 946 824 901 996 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
2
bugs gh 7436 
 tracker
 SS 741 931 739 743 914 724 733 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
3
functional arno optimizer opt sort by index 10 
 CS 662 851 552 544 544 609 659 702 638 571 715 674 710 643 623 665 616 649 836 880 981 967 907 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
4
functional arno optimizer opt sort by index 10 
 SS 459 389 381 387 402 385 440 554 458 428 634 464 487 424 433 460 461 419 565 528 496 545 518 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
5
functional arno optimizer opt sort by index 13 
 CS 660 856 533 560 522 578 657 663 649 636 687 637 695 617 591 622 669 669 836 954 965 1012 914 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
6
functional arno optimizer opt sort by index 13 
 SS 457 411 389 427 398 418 426 495 470 476 659 464 467 424 425 450 417 416 522 530 526 564 560 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
7
functional arno optimizer opt sort by index 19 
 CS 519 674 404 415 393 474 508 569 492 467 502 532 526 491 524 534 514 494 665 758 826 802 733 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
8
functional arno optimizer opt sort by index 19 
 SS 340 279 285 276 259 306 358 378 308 364 554 309 346 322 334 356 335 324 469 412 440 477 459 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird/issues/7436

=== end of list ===