01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (17 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2528 rows)
11. All tests: durations for previous 30 runs
12. Skipped: tests which was intentionally excluded from execution (70 rows)

Generated 27.07.2024 06:44
Tested: FB50.   Build/date: 5.0.1.1452 2024.07.26; latest GH: b056f5b4;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; firebird.Qa: 0.19.3 

Test with at least one result = "FAIL" for last 30 runs:

Jump to the list of unique test names from this report
Jump to the list with last developing commits information

NN Test name mode
5.0.1.1452
2024.07.26
5.0.1.1446
2024.07.24
5.0.1.1445
2024.07.23
5.0.1.1440
2024.07.13
5.0.1.1439
2024.07.10
5.0.1.1434
2024.07.09
5.0.1.1432
2024.07.06
5.0.1.1430
2024.06.30
5.0.1.1428
2024.06.27
5.0.1.1425
2024.06.21
5.0.1.1421
2024.06.18
5.0.1.1417
2024.06.17
5.0.1.1416
2024.06.13
5.0.1.1415
2024.06.09
5.0.1.1412
2024.06.08
5.0.1.1408
2024.05.24
5.0.1.1405
2024.05.21
5.0.1.1404
2024.05.15
5.0.1.1399
2024.05.14
5.0.1.1398
2024.05.09
5.0.1.1397
2024.05.08
5.0.1.1395
2024.05.06
5.0.1.1394
2024.05.05
5.0.1.1393
2024.05.01
5.0.1.1392
2024.04.29
5.0.1.1391
2024.04.28
5.0.1.1390
2024.04.26
5.0.1.1389
2024.04.25
5.0.1.1387
2024.04.22
5.0.1.1386
2024.04.19
Test TITLE
100 SS P P P P F P P P P P P P P P P P P P P P P P P P P F P P P P
Count ( DISTINCT ... ) is too slow
100 CS P P P P P P P P P P P P P F F P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
100 SS P P P P P P P P P P P P P F F P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
100 CS P P P P P P P P P P P P P F F F F F F F F F F F F F F F P F
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
100 SS P P P P F P P P P P P P P F F F F F F F F F F F F F F F F F
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
100 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make the profiler store aggregated requests by default, with option for detailed store
100 SS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Make the profiler store aggregated requests by default, with option for detailed store
100 CS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
100 SS P P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
Extend rdb$get_context('SYSTEM', '***') with client-related info
800 CS X X X X X X X X X X X X X X X X X F X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
800 SS X X X X X X X X X X X X X X X X X F X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
800 CS X X X X X X X X X X X X X X X X X F X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
800 SS X X X X X X X X X X X X X X X X X F X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
100 CS P P P P F F F F F P P F F P P P P P P P P P P P P P P P P P
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
100 SS P P P P F F F F F P P F F P P P P P P P P P P P P P P P P P
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
100 CS P P P P F F F F F P P F F P P P P P P P P P P P P P P P P P
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
100 SS P P P P F F F F F P P F F P P P P P P P P P P P P P P P P P
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.1.1452
2024.07.26
5.0.1.1446
2024.07.24
5.0.1.1445
2024.07.23
5.0.1.1440
2024.07.13
5.0.1.1439
2024.07.10
5.0.1.1434
2024.07.09
5.0.1.1432
2024.07.06
5.0.1.1430
2024.06.30
5.0.1.1428
2024.06.27
5.0.1.1425
2024.06.21
5.0.1.1421
2024.06.18
5.0.1.1417
2024.06.17
5.0.1.1416
2024.06.13
5.0.1.1415
2024.06.09
5.0.1.1412
2024.06.08
5.0.1.1408
2024.05.24
5.0.1.1405
2024.05.21
5.0.1.1404
2024.05.15
5.0.1.1399
2024.05.14
5.0.1.1398
2024.05.09
5.0.1.1397
2024.05.08
5.0.1.1395
2024.05.06
5.0.1.1394
2024.05.05
5.0.1.1393
2024.05.01
5.0.1.1392
2024.04.29
5.0.1.1391
2024.04.28
5.0.1.1390
2024.04.26
5.0.1.1389
2024.04.25
5.0.1.1387
2024.04.22
5.0.1.1386
2024.04.19
Test TITLE
1 SS 1602 1718 1722 1950 1745 2016 1774 1742 1768 1744 1732 1769 1826 1709 1516 1532 1548 1563 1547 1547 1641 1547 1562 1531 1532 1531 1891 1547 1516 1531 1516
Count ( DISTINCT ... ) is too slow
2 CS 735 889 769 766 766 718 906 797 896 762 760 774 853 793 1078 1047 688 734 719 734 719 734 703 734 735 734 734 734 735 734 734
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
3 SS 453 556 527 554 543 500 516 528 772 552 536 536 514 516 766 766 407 390 391 390 406 391 406 390 406 406 407 406 390 390 406
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
4 CS 22440 21571 21582 21567 21596 21531 21576 21555 21796 21583 21589 21579 21581 21578 22471 22410 22815 22815 22815 22800 22800 22815 22800 22800 22801 22816 22815 22816 22800 21475 22800
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
5 SS 22237 21387 21357 21373 21354 21313 21362 21355 21359 21362 21350 21374 21372 21363 22237 22237 22612 22612 22596 22612 22612 22580 22612 22597 22596 22597 22240 22597 22597 21613 22596
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
6 CS 1178 1175 1171 1186 1181 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make the profiler store aggregated requests by default, with option for detailed store
7 SS 874 867 905 866 882 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make the profiler store aggregated requests by default, with option for detailed store
8 CS 366 369 366 368 371 360 363 364 374 369 364 366 386 384 344 313 344 344 344 391 344 391 344 343 391 375 390 391 344 360 391
Extend rdb$get_context('SYSTEM', '***') with client-related info
9 SS 141 204 211 198 208 188 219 198 205 206 199 224 208 207 141 141 141 140 125 141 140 125 140 140 141 141 141 125 141 141 141
Extend rdb$get_context('SYSTEM', '***') with client-related info
10 CS 2594 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2594 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
11 SS 2360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2360 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
12 CS 2579 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2579 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
13 SS 2375 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2375 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
14 CS 6719 5753 6894 5690 5744 69123 69187 69125 69207 69147 6704 5769 69247 69390 6719 6016 6782 5750 5719 5704 6720 6719 6782 6719 5719 6720 5751 5735 7735 6741 5782
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
15 SS 6805 7268 6244 6288 6302 68143 68474 68446 68701 68466 6096 6101 68507 69507 7063 5954 6063 4906 7047 7047 6111 7048 7064 6095 6095 7079 6563 6094 6048 6112 7048
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
16 CS 13873 12796 12858 13871 12823 77486 77629 77691 71827 76644 13814 13880 66875 66782 13954 13611 13877 12846 12939 12877 13861 13908 13877 13876 13861 13908 12878 13892 13861 12881 13861
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
17 SS 13135 13155 14172 13179 13162 76648 76732 76724 76981 76750 13168 13144 66175 66155 14112 12986 13110 14096 13111 13111 13127 13111 13111 13111 13096 13095 13112 13111 13096 13119 13095
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-214
http://tracker.firebirdsql.org/browse/core-5236
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol_cr_space_nl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_invalid_msg_if_target_db_has_no_replica_flag.py
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/7652
https://github.com/FirebirdSQL/firebird/issues/7818

=== end of list ===

Last commits information: