01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (1 rows)
03. NEW FAILS: tests which failed for LAST run (8 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (207 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (5 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (18 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (213 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (1 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2713 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated UTC 26.06.2025 08:23
Tested: FB40.   Build / date: 4.0.6.3215-6461d039 / 2025.06.25;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.04.12
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.27
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
Test TITLE
1 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
2 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE VIEW ignores PLAN
3 SS P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
4 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
5 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
6 SS P P P P P P P P P P P P P P P P P F P P P F P P P P P P P P
Database creation in 3.0.12, 4.0.5 and 5.0.1 slower than in previous releases
7 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
gbak: Incorrect total statistics for restore
8 SS P P P P P P P P P P P P P P P P P P P P P F X X X X X X X X
Segfault when already destroyed callback interface is used
9 CS X X X X X X X X X X X X X X F X X X X X X X X X X X X X X X
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
10 SS X X X X X X X X X X X X X X F X X X X X X X X X X X X X X X
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
11 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
12 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Make asynchronous replica re-initialization reliable #8324
13 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Applying full DDL from OLTP-EMUL test on master with further check replica
14 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Crash or hang while shutting down the replica database if segments are being applied
15 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Some updates can crash Firebird server on replica side
16 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
17 CS P P P P F P P X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals
18 SS E P P P F P P X X X X X X X X X X X X X X X X X X X X X X X
Comparison of string and numeric literals

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3215
2025.06.25
4.0.6.3214
2025.06.21
4.0.6.3213
2025.06.14
4.0.6.3212
2025.06.11
4.0.6.3208
2025.06.10
4.0.6.3207
2025.06.07
4.0.6.3206
2025.05.22
4.0.6.3205
2025.05.07
4.0.6.3204
2025.05.06
4.0.6.3203
2025.05.05
4.0.6.3200
2025.04.18
4.0.6.3199
2025.04.14
4.0.6.3198
2025.04.13
4.0.6.3195
2025.04.12
4.0.6.3195
2025.03.28
4.0.6.3194
2025.03.27
4.0.6.3194
2025.03.26
4.0.6.3193
2025.03.20
4.0.6.3192
2025.03.13
4.0.6.3191
2025.03.10
4.0.6.3190
2025.02.25
4.0.6.3189
2025.02.22
4.0.6.3188
2025.02.21
4.0.6.3186
2025.02.19
4.0.6.3185
2025.02.16
4.0.6.3183
2025.02.04
4.0.6.3181
2025.02.01
4.0.6.3180
2025.01.27
4.0.6.3179
2025.01.24
4.0.6.3178
2025.01.20
Test TITLE
1 CS 692 1094 702 694 682 708 691 744 672 684 685 699 750 690 671 690 691 735 757 719 711 723 694 682 688 718 708 690 675 687 687
CREATE VIEW ignores PLAN
2 SS 488 819 469 490 484 473 508 484 452 471 480 475 489 487 453 488 498 514 533 493 503 511 519 477 511 469 490 501 472 490 485
CREATE VIEW ignores PLAN
3 SS 1848 1855 1839 1862 1863 1859 1841 2163 1806 1845 1847 1838 1839 1828 1805 1871 1876 1869 1883 1827 1864 1878 1857 1818 1869 1841 1866 1842 1849 1829 1847
DELETE FROM MON$STATEMENTS does not interrupt a longish fetch
4 CS 629 684 646 625 606 609 610 646 593 636 979 641 605 619 594 639 641 685 661 638 634 648 623 605 617 648 614 617 693 611 604
Some (wrong ?) parameters of ENCRYPT() leads FB to crash
5 CS 21679 21695 21679 21707 21676 21665 21685 21705 21954 21668 21676 21770 21672 21673 21641 21890 21656 21671 22113 21675 21679 21706 21783 21660 21681 21662 21665 21699 21663 21680 21694
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
6 SS 11560 11322 11845 11639 11781 11521 11946 11530 11203 11307 11720 11329 11815 11590 11188 11312 11623 12044 12353 11411 11591 12055 12315 11348 12342 11721 11441 11419 11460 11397 11414
Database creation in 3.0.12, 4.0.5 and 5.0.1 slower than in previous releases
7 SS 2635 2611 3112 2508 2543 2679 2756 2543 2547 2481 2603 2660 3087 2560 2359 2676 2663 2787 2508 2670 2594 2607 2674 2577 2758 2748 2714 2476 2748 2696 383
gbak: Incorrect total statistics for restore
8 SS 2271 2240 2389 2279 2276 2246 2275 2237 2214 2227 2243 2282 2385 2267 2214 2200 2345 2436 2434 2249 2347 2418 1750 0 0 0 0 0 0 0 0
Segfault when already destroyed callback interface is used
9 CS 879 0 0 0 0 0 0 0 0 0 0 0 0 0 0 879 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
10 SS 663 0 0 0 0 0 0 0 0 0 0 0 0 0 0 663 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
fix(cast-format): Throw exception when value cannot be found for specific pattern in string to datetime conversion
11 SS 13156 2492 12175 12180 13167 13215 13315 13164 12099 13182 13171 13144 12180 13148 13131 14168 12348 12236 13414 13185 13490 13429 13149 13161 13159 12156 13166 13206 13154 13142 13152
Invalid message in replication.log (and possibly crash in the case of synchronous replication) when the target DB has no its "replica" flag set
12 SS 100530 2293 101746 99611 98843 105399 99217 101892 101516 101405 99317 102321 98280 102474 99214 101908 103727 98497 102244 103421 99115 101552 98509 98550 100543 100518 102434 99549 99815 99684 102587
Make asynchronous replica re-initialization reliable #8324
13 SS 19262 2460 19677 19916 18861 19271 22180 22424 19394 19710 18590 19788 19052 19626 18968 18991 18743 19253 19697 18980 18847 19596 19749 19295 19853 19030 20002 19186 19217 18833 18845
Applying full DDL from OLTP-EMUL test on master with further check replica
14 SS 13589 2479 13802 13739 13529 13714 13181 14178 13858 13075 13337 14113 13703 13057 12822 12886 13581 13876 13397 13500 13544 13826 13212 13598 13824 13793 14211 13129 13210 13753 13597
Crash or hang while shutting down the replica database if segments are being applied
15 SS 6103 2242 6403 6082 6095 6547 6159 6120 6065 6105 6094 6099 6087 6119 6047 6121 6143 6762 6270 6109 6139 6162 6072 6089 6094 6112 6117 6085 6089 6085 6101
Some updates can crash Firebird server on replica side
16 SS 6092 2444 6173 6098 6089 6172 6194 6191 6029 6112 6080 6083 6084 6087 6048 6068 6138 6160 6529 6092 6136 6620 6080 6084 6093 6076 6115 6068 6090 6093 6100
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
17 CS 605 603 605 640 600 610 619 594 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals
18 SS 433 2456 440 417 406 434 433 424 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Comparison of string and numeric literals

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-203
http://tracker.firebirdsql.org/browse/CORE-3977
http://tracker.firebirdsql.org/browse/CORE-6185
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_invalid_msg_if_target_db_has_no_replica_flag.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_oltp_emul_ddl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_shutdown_during_applying_segments_leads_to_crash.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_some_updates_crash_server_on_replica_side.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_updating_blob_with_empty_string_stops_replication.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/sqlancer/doi_10_1145_3428279_example_18_test.py
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/8219
https://github.com/FirebirdSQL/firebird/issues/8391
https://github.com/FirebirdSQL/firebird/issues/8429
https://github.com/FirebirdSQL/firebird/issues/8501
=== end of list ===

Last commits information (all timestamps in UTC):