01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
[CURRENT] 04. STILL FAILS: tests which fail for at least TWO LAST runs (32 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (9 rows)
07. Has fails: tests with at least one fail for previous 30 runs (120 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1105 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
11. All tests: outcomes for previous 30 runs (3710 rows)
12. Skipped: tests which was intentionally excluded from execution (80 rows)

Generated UTC 31.03.2025 10:16
Tested: HQ50.   Build / date: 5.0.3.1633-3123a5a0 / 2025.03.28;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests which fail for at least TWO last runs:

NN Test name mode
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
Test TITLE
1 CS F F P P F F P F F F P P P F F F F F P F F P P P F F P F F F
Compress Data over the Network
2 CS F F F F F F F F F F F F F F F F F F F F F P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS F F F F F F F F F F F F F F F F F F F F F P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS F F F F F F F F F F F F F F F F F F F F E F X X X X X X X X
Events in system attachments (like garbage collector) are not traced
5 CS F F F F F F F F F F F F F F F F F F F F F F F F F F X X X X
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS F F F F F F F F F F F F X X X X X X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS F F P P P P P P P P F F X X X X X X X X X X X X X X X X X X
gbak: Incorrect total statistics for restore
8 CS F F F F F F F X X X X X X X X X X X X X X X X X X X X X X X
A user with "GRANT_REVOKE_ON_ANY_OBJECT" privilege can't revoke a role from himself if he is not a grantor
9 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Inheritance of WINDOW does not work
10 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi)
12 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
ORDER BY ASC using index (multi) and WHERE clause
13 CS F F F F F F F F F F F F F F F F F F P P P P P P P P P P P P
ISQL - SHOW SYSTEM TABLES
14 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Add REPLICA MODE to the output of the isql SHOW DATABASE command
15 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
ISQL showing publication status
16 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Characters are garbled when replicating fields with type BLOB SUB_TYPE TEXT if the character set of the connection and the field are different
17 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Error "BLOB is not found" while replication converts INSERT into UPDATE for a conflicting record
18 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Problem with replication of BLOB segments longer than 32KB
19 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Replica DB must not fire DB-level triggers but their activity on master must be eventually seen in replica
20 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
DDL-triggers must fire only on master DB
21 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Disallow replication of RDB$BACKUP_HISTORY
22 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Conflicting INSERT propagated into a read-write replica may cause duplicate records to appear
23 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Failed DDL commands can be replicated
24 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Generator values may not replicate after commit
25 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
26 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
27 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
28 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Applying full DDL from OLTP-EMUL test on master with further check replica
29 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Crash or hang while shutting down the replica database if segments are being applied
30 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Some updates can crash Firebird server on replica side
31 SS F F P P P P P P F P P P P P P P P P P P F P P P P P F F P P
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
32 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1633
2025.03.28
5.0.3.1633
2025.03.27
5.0.3.1631
2025.03.25
5.0.3.1631
2025.03.21
5.0.3.1629
2025.03.18
5.0.3.1628
2025.03.14
5.0.3.1627
2025.02.26
5.0.3.1624
2025.02.25
5.0.2.1615
2025.02.20
5.0.2.1615
2025.02.14
5.0.2.1577
2025.02.07
5.0.2.1577
2024.12.24
5.0.2.1576
2024.12.17
5.0.2.1575
2024.12.09
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.08
5.0.2.1567
2024.12.07
5.0.2.1567
2024.12.02
5.0.2.1567
2024.11.26
5.0.2.1567
2024.11.21
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.07
Test TITLE
1 CS 16970 17080 17338 16997 17108 19684 17369 17187 17231 17656 16996 16698 16271 16309 18168 16591 16359 16553 16017 16161 16695 16836 17062 16205 16373 17010 18835 16089 16945 16942 17143
Compress Data over the Network
2 CS 1553 1514 1515 1841 1826 1570 1536 1917 1483 1506 1354 1474 1482 1832 1518 1260 1350 1445 1253 1833 1471 1468 2706 2708 2710 2728 2691 2720 2777 2782 2802
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
3 SS 1069 1315 771 1131 1203 1032 1063 1150 762 1037 1073 743 956 741 1052 660 732 749 662 1067 1063 1071 1898 1940 1913 1922 1908 1921 1950 1935 1948
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
4 SS 321 318 413 325 328 291 571 326 324 295 429 301 570 304 299 239 482 243 470 298 313 2384 301 0 0 0 0 0 0 0 0
Events in system attachments (like garbage collector) are not traced
5 CS 1088 1077 1076 1078 1390 1044 1031 1089 1148 1069 1072 1092 1091 1104 1088 984 1102 3251 973 1060 1059 1311 1087 1427 1427 1099 1094 0 0 0 0
gbak on Classic with ParallelWorkers > 1 doesn't restore indices, giving a cryptic error message
6 CS 1094 1094 1133 1094 1108 1079 1115 1089 1084 1094 1089 1094 1133 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when creating index on table that uses UDR and ParallelWorkers > 1
7 SS 2698 3309 3026 2748 2678 2718 2747 2569 2415 2587 2793 2644 2641 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gbak: Incorrect total statistics for restore
8 CS 1757 1704 1778 1757 1782 1727 1725 1768 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
A user with "GRANT_REVOKE_ON_ANY_OBJECT" privilege can't revoke a role from himself if he is not a grantor
9 CS 646 641 651 620 660 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inheritance of WINDOW does not work
10 CS 841 867 1108 840 853 833 843 849 894 828 810 831 827 818 826 749 807 858 742 819 826 868 825 835 859 855 853 870 948 979 1030
ORDER BY ASC using index (multi)
11 CS 850 858 916 856 854 836 844 889 898 851 833 842 811 854 812 775 873 912 763 853 829 845 810 830 865 821 845 849 938 1004 977
ORDER BY ASC using index (multi)
12 CS 626 628 716 668 629 594 629 619 642 647 615 599 607 611 607 545 571 657 572 607 594 877 618 634 624 610 642 670 717 668 670
ORDER BY ASC using index (multi) and WHERE clause
13 CS 609 633 677 626 615 597 586 615 658 875 589 589 599 594 599 573 608 642 531 613 589 623 606 611 600 613 597 583 653 655 656
ISQL - SHOW SYSTEM TABLES
14 SS 353 2091 2336 393 381 380 359 377 313 2076 371 356 308 311 309 281 351 347 350 384 307 2097 311 322 324 305 368 2088 2082 310 308
Add REPLICA MODE to the output of the isql SHOW DATABASE command
15 SS 157 2077 2120 157 173 154 156 155 156 2077 158 159 155 154 156 139 144 143 141 158 155 2077 159 158 162 157 158 2113 2089 158 156
ISQL showing publication status
16 SS 8836 2194 2438 9291 8631 9544 8769 8759 8903 2394 8548 9701 9560 9734 9558 9511 9032 9357 9498 8589 9548 2199 8694 9745 8706 8722 9584 2380 2221 8698 9692
Characters are garbled when replicating fields with type BLOB SUB_TYPE TEXT if the character set of the connection and the field are different
17 SS 9132 2401 2405 9057 9149 9112 10217 10029 9138 2200 9040 9127 9037 9195 9044 9381 10056 10030 9512 10130 9082 2627 10160 9099 10070 10322 9238 2418 2414 9250 8976
Error "BLOB is not found" while replication converts INSERT into UPDATE for a conflicting record
18 SS 6415 2198 2437 7077 6925 7428 5406 5817 6527 2372 6419 6422 6471 6445 6412 6088 6109 6031 6161 5662 6483 2201 5772 6457 6434 6425 6775 2233 2190 6554 6583
Problem with replication of BLOB segments longer than 32KB
19 SS 6165 2388 2210 5231 6218 6225 6176 6177 6446 2200 6138 6201 6219 6221 6170 6059 6041 6257 6030 6142 6161 2428 6158 6407 6169 6171 6196 2394 2389 6194 6155
Replica DB must not fire DB-level triggers but their activity on master must be eventually seen in replica
20 SS 6379 2395 2420 7422 6411 7475 7347 6413 6404 2388 7398 6368 7395 6389 7411 6252 6245 7696 6293 6409 7410 2430 7417 6422 6355 6369 6337 2219 2210 6368 6358
DDL-triggers must fire only on master DB
21 SS 8565 2226 2217 8661 8586 8762 8671 9329 9632 2406 8473 8857 8352 6259 8936 6702 6092 8359 8870 9629 8412 2197 9060 9405 8544 8657 6093 2412 2391 9517 9086
Disallow replication of RDB$BACKUP_HISTORY
22 SS 8789 2392 2403 8789 9663 8719 9740 8790 8637 2248 9580 9681 9544 8715 8726 8526 9368 9477 9497 8718 9705 2383 8700 9026 9568 9564 9705 2428 2393 8752 9698
Conflicting INSERT propagated into a read-write replica may cause duplicate records to appear
23 SS 6134 2204 2193 6462 6164 6147 5260 6523 6196 2407 6132 6136 6130 6129 6172 6017 6013 7301 6029 6137 6149 2203 6137 6211 6150 6116 6125 2197 2193 6149 6148
Failed DDL commands can be replicated
24 SS 6062 2387 2393 6122 6128 6097 6440 6077 6097 2199 6079 6057 6068 6076 6056 6926 5925 6029 5953 6057 6149 2390 6054 6134 6084 6057 6063 2412 2425 6062 6066
Generator values may not replicate after commit
25 SS 13145 2197 2254 12172 12235 13236 13265 13556 12165 2402 13131 13142 12129 13151 13124 13019 14084 13478 14025 13185 13162 2413 13168 13601 13205 13187 13191 2227 2211 13148 12181
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
26 CS 51237 49736 51556 50014 54476 53461 49856 50610 50918 50244 50821 53798 53754 53472 52888 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
27 SS 50900 2398 2392 50393 54471 50426 51374 52927 53414 2213 54560 51399 53443 49221 48625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
28 SS 15927 2205 2389 14570 16587 16843 17267 16922 16760 2391 16335 16708 14426 14084 15931 16332 15626 15995 15646 16818 15857 2213 16386 15787 13404 16475 15924 2393 2369 16292 16116
Applying full DDL from OLTP-EMUL test on master with further check replica
29 SS 13676 2427 2394 13196 13770 13159 13921 13837 13255 2203 14149 13544 13374 14777 13783 13420 14422 13301 13214 14286 14389 2401 14184 14151 14179 13601 14181 2213 2207 14212 13751
Crash or hang while shutting down the replica database if segments are being applied
30 SS 6152 2207 2409 6132 7160 7152 7166 6158 6147 2389 6075 6078 6076 6069 6214 6953 6942 7035 6966 7067 7090 2195 6102 6180 7079 6106 7075 2403 2382 7075 6058
Some updates can crash Firebird server on replica side
31 SS 6070 2391 2204 6122 6135 5659 6271 6091 7112 2202 6082 6059 6054 6080 7105 5972 5929 6013 5944 6073 6114 2416 6076 6656 6083 7090 6070 2214 2411 6070 6056
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
32 CS 1479 1506 1861 1550 1511 1550 1458 1536 1521 1461 1505 1478 1467 1430 1445 1328 1369 1479 1420 1445 1454 1467 1426 1480 1575 1479 1467 1736 1721 1954 1743
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/basic/isql/test_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_characters_garbled_when_conn_charset_differs.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_not_found_in_rw_replica_if_target_row_exists.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_blob_segments_longer_32kb_are_not_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_dblevel_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_ddl_triggers_must_not_fire_on_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_disallow_rdb_backup_history_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_duplicates_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_failed_ddl_commands_can_be_replicated.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_generator_could_not_be_transferred_to_replica.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_invalid_msg_if_target_db_has_no_replica_flag.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_oltp_emul_ddl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_shutdown_during_applying_segments_leads_to_crash.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_some_updates_crash_server_on_replica_side.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_updating_blob_with_empty_string_stops_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8263
https://github.com/FirebirdSQL/firebird/issues/8386
https://github.com/FirebirdSQL/firebird/issues/8391
https://github.com/FirebirdSQL/firebird/issues/8462
https://github.com/FirebirdSQL/firebird/issues/8477
=== end of list ===

Last commits information (all timestamps in UTC):