01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (6 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (8 rows)
06. Has fails: tests with at least one fail for previous 30 runs (128 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (16 rows)
10. All tests: outcomes for previous 30 runs (2559 rows)
11. All tests: durations for previous 30 runs (4980 rows)
12. Skipped: tests which was intentionally excluded from execution (70 rows)

Generated 15.06.2024 10:51
Tested: HQ50.   Build: 5.0.1.1415;   SS: 15.06.24 09:14:34 - 15.06.24 09:56:15;   CS: 15.06.24 09:56:56 - 15.06.24 10:50:22;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 5.0.1.1415
2024-06-15
5.0.1.1401
2024-06-10
5.0.1.1398
2024-05-22
5.0.1.1397
2024-05-10
5.0.1.1392
2024-05-08
5.0.1.1386
2024-04-27
5.0.1.1378
2024-04-20
5.0.1.1346
2024-04-07
5.0.1.1340
2024-02-21
5.0.1.1325
2024-02-15
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
2 SS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
3 CS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
4 SS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
5 CS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
6 SS F F F F F F F F F F P X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
7 CS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1415
2024-06-15
5.0.1.1401
2024-06-10
5.0.1.1398
2024-05-22
5.0.1.1397
2024-05-10
5.0.1.1392
2024-05-08
5.0.1.1386
2024-04-27
5.0.1.1378
2024-04-20
5.0.1.1346
2024-04-07
5.0.1.1340
2024-02-21
5.0.1.1325
2024-02-15
5.0.1.1318
2024-01-26
X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 801 718 791 797 1087 795 1170 801 812 803 821 794 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
2 SS 477 453 457 475 1124 480 823 465 477 772 473 482 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
3 CS 788 796 781 797 781 788 778 769 830 775 811 802 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
4 SS 484 452 477 485 484 482 515 492 473 1028 480 491 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
5 CS 518 483 518 546 482 559 558 542 483 496 542 496 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
6 SS 334 296 334 346 336 341 395 324 331 994 322 312 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
7 CS 1518 1406 1565 1470 1537 1490 1495 1556 1579 1466 1629 1518 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
8 SS 1049 999 1091 1035 1088 1048 1049 1051 1042 1066 1068 1024 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py

=== end of list ===