01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (20 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2513 rows)
11. All tests: durations for previous 30 runs (4860 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 15.06.2024 06:30
Tested: FB50.   Build: 5.0.1.1416;   SS: 15.06.24 04:53:22 - 15.06.24 05:35:51;   CS: 15.06.24 05:36:32 - 15.06.24 06:29:39;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

Jump to LIST of unique test names from this report

NN Test name mode 5.0.1.1416
2024-06-15
5.0.1.1415
2024-06-13
5.0.1.1412
2024-06-09
5.0.1.1411
2024-06-06
5.0.1.1408
2024-05-29
5.0.1.1405
2024-05-22
5.0.1.1404
2024-05-21
5.0.1.1399
2024-05-15
5.0.1.1398
2024-05-14
5.0.1.1395
2024-05-08
5.0.1.1394
2024-05-06
5.0.1.1393
2024-05-02
5.0.1.1392
2024-04-30
5.0.1.1391
2024-04-29
5.0.1.1390
2024-04-27
5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-13
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1375
2024-04-03
5.0.1.1373
2024-04-02
5.0.1.1372
2024-03-26
5.0.1.1371
2024-03-23
5.0.1.1370
2024-03-21
5.0.1.1369
2024-03-19
5.0.1.1368
2024-03-16
Test TITLE
1 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P F P P
Count ( DISTINCT ... ) is too slow
2 CS P P P P P P P F P P P P F P P P P P P P F P P P P P P P P P
Compress Data over the Network
3 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
4 CS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
5 SS F F F P P P P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 CS P P P P P P P P P P P P P P P P P P P P P P P F F F F F F F
Slow changes on domain
8 SS P P P P P P P P P P P P P P P P P P P P P P P F F F F F F F
Slow changes on domain
9 SS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
"SIMILAR TO" hangs when processing parenthesis
10 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
11 SS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Performance problem when using SRP plugin
12 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Wire compression causes freezes
13 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
14 CS P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
15 SS P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
16 CS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
Server crashes with IN (dbkey1, dbkey2, ...) condition
17 SS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
Server crashes with IN (dbkey1, dbkey2, ...) condition
18 CS P P P P P P P P P P P P P P P P P P P P P P P F F F F F F P
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
19 SS P P P P P P P P P P P P P P P P P P P P P P P F F F F F F P
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
20 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1416
2024-06-15
5.0.1.1415
2024-06-13
5.0.1.1412
2024-06-09
5.0.1.1411
2024-06-06
5.0.1.1408
2024-05-29
5.0.1.1405
2024-05-22
5.0.1.1404
2024-05-21
5.0.1.1399
2024-05-15
5.0.1.1398
2024-05-14
5.0.1.1395
2024-05-08
5.0.1.1394
2024-05-06
5.0.1.1393
2024-05-02
5.0.1.1392
2024-04-30
5.0.1.1391
2024-04-29
5.0.1.1390
2024-04-27
5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-13
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1375
2024-04-03
5.0.1.1373
2024-04-02
5.0.1.1372
2024-03-26
5.0.1.1371
2024-03-23
5.0.1.1370
2024-03-21
5.0.1.1369
2024-03-19
5.0.1.1368
2024-03-16
Test TITLE
1 CS 1982 1936 2085 1989 1939 2270 1941 1929 3093 1947 1997 2213 2008 2286 2163 1957 1928 1929 2309 1976 2491 2271 1922 1929 2129 1964 2324 1936 2694 1951 1921
Count ( DISTINCT ... ) is too slow
2 CS 24392 23859 25238 23705 23909 24572 24452 24545 104610 24802 24354 24279 24635 25220 24247 26562 23957 24429 24511 24356 25498 24898 24548 23965 24321 24061 24349 23648 24443 23950 24343
Compress Data over the Network
3 CS 6707 6607 6939 6650 7050 6786 6638 6647 29974 7374 6776 6715 6718 6691 6722 6926 6640 6746 6770 6697 6669 6699 6675 6803 6648 6636 6725 6647 6645 6768 6602
Ability to cancel waiting in lock manager
4 CS 802 1093 1213 1138 832 834 946 760 1391 770 882 879 758 762 764 837 753 771 760 879 753 821 940 770 877 783 759 753 762 831 733
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
5 SS 526 811 836 893 526 492 539 548 508 567 520 527 528 540 523 557 510 522 508 526 523 536 524 509 526 544 535 495 524 507 483
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
6 CS 2948 2920 2948 2934 2935 2949 2942 2948 8369 2964 2943 2940 2937 2945 2942 2970 3054 3190 2936 3017 2971 3229 2962 2956 2947 2948 3300 2945 2944 2958 2921
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
7 CS 4896 4671 4780 4749 4730 5014 4787 4853 7414 5403 4791 4844 4769 4973 5370 4790 4883 4862 4909 4783 5134 4915 4862 4781 6647 6571 6553 6570 6207 8030 7873
Slow changes on domain
8 SS 4325 4140 4238 4747 4252 4451 4259 4330 5721 4275 4456 4252 4254 4769 4237 4265 4305 4319 4258 4282 4742 4340 4228 4320 6038 6439 6149 5998 6044 7627 7780
Slow changes on domain
9 SS 300 280 303 288 298 297 298 295 7183 296 299 311 295 316 312 301 312 314 301 303 306 294 303 311 296 294 300 301 302 300 296
"SIMILAR TO" hangs when processing parenthesis
10 CS 3486 3374 3466 12187 3617 3908 3408 3490 8220 3787 3372 3580 3881 3388 3464 3564 3443 3522 3507 3553 3931 3474 3500 3419 3831 3353 3372 3359 3451 3483 3405
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
11 SS 4987 13483 5010 4897 5027 4901 4938 4957 7927 5130 5018 4986 4939 5571 4998 5533 4955 5075 5029 4984 4926 4913 4955 4955 5006 5006 4970 5042 4988 4940 4858
Performance problem when using SRP plugin
12 CS 33597 32827 33811 33856 33397 33741 33150 33481 65211 35318 34161 33603 40675 33417 33285 33673 33492 33516 34200 33812 34922 33228 33753 33869 33708 33571 33283 33591 33231 33385 32828
Wire compression causes freezes
13 SS 21359 21342 21379 21339 21359 21346 21361 21343 21450 21373 21359 21338 21355 21390 21367 21385 21373 21362 21345 21385 21386 21355 21341 21369 21358 21337 21367 21358 21365 21360 21343
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
14 CS 1686 1592 1743 1691 1693 1643 1648 1682 1677 1747 2432 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
15 SS 1014 999 1017 1006 1010 1018 1011 1003 1248 1028 1810 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
16 CS 481 452 565 481 470 935 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server crashes with IN (dbkey1, dbkey2, ...) condition
17 SS 297 280 303 295 297 863 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server crashes with IN (dbkey1, dbkey2, ...) condition
18 CS 6703 6708 5743 5760 5848 6743 6680 6852 7694 5916 5731 6714 6698 5786 5694 6813 5727 5781 6667 5726 6734 6688 5771 6751 69038 69082 69026 69092 69127 69039 13882
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
19 SS 6644 7067 6112 6044 7081 6111 6113 6064 8089 6053 6062 6062 7063 6039 6047 6102 7097 6074 7095 7055 6058 6234 6096 7106 68467 68533 68345 68313 68522 68507 14100
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
20 CS 29026 28914 29002 29208 28969 29383 29175 28983 29668 29362 29028 29074 28968 28951 29025 29198 29058 29171 28946 29023 29607 29019 28984 29065 29042 28939 28991 29066 28973 29848 28900
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-214
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-5236
http://tracker.firebirdsql.org/browse/core-5488
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-6088
http://tracker.firebirdsql.org/browse/core-6142
http://tracker.firebirdsql.org/browse/core-6237
http://tracker.firebirdsql.org/browse/core-6348
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/8066
https://github.com/FirebirdSQL/firebird/issues/8136

=== end of list ===