01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (8 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2462 rows)
11. All tests: durations for previous 30 runs (4758 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated 26.04.2024 07:49
Tested: FB50.   Build: 5.0.1.1389;   SS: 26.04.24 06:03:20 - 26.04.24 06:48:01;   CS: 26.04.24 06:49:12 - 26.04.24 07:47:38;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-14
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1373
2024-04-01
5.0.1.1372
2024-03-29
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
5.0.1.1344
2024-02-21
5.0.1.1342
2024-02-19
5.0.1.1340
2024-02-18
5.0.1.1339
2024-02-13
5.0.1.1338
2024-02-12
5.0.1.1336
2024-02-11
5.0.1.1335
2024-02-10
5.0.1.1332
2024-02-07
5.0.1.1331
2024-02-04
5.0.1.1330
2024-02-03
5.0.1.1329
2024-02-02
Test TITLE
1 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
2 CS P P P P P F P P P P P P P P P P P P P P P P P P P P P P P F
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
3 CS P P P P P P P P F F F F F F F F F F P P P P P P P P P P P P
Slow changes on domain
4 SS P P P P P P P P F F F F F F F F F F P P P P P P P P P P P P
Slow changes on domain
5 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
6 SS P P P P P P P P P P P P P P P P P P P P P P P F P P P P P P
garbage collection in indexes and blobs is not performed in VIO_backout
7 CS P P P P P P P P P P F F F P P X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
8 SS P P P P P P P P P P F F F P P X X X X X X X X X X X X X X X
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.1.1389
2024-04-26
5.0.1.1387
2024-04-25
5.0.1.1386
2024-04-21
5.0.1.1383
2024-04-19
5.0.1.1381
2024-04-17
5.0.1.1379
2024-04-14
5.0.1.1378
2024-04-10
5.0.1.1377
2024-04-04
5.0.1.1373
2024-04-01
5.0.1.1372
2024-03-29
5.0.1.1371
2024-03-24
5.0.1.1370
2024-03-22
5.0.1.1369
2024-03-17
5.0.1.1368
2024-03-16
5.0.1.1363
2024-03-15
5.0.1.1360
2024-03-14
5.0.1.1358
2024-03-13
5.0.1.1348
2024-03-09
5.0.1.1347
2024-03-05
5.0.1.1344
2024-02-21
5.0.1.1342
2024-02-19
5.0.1.1340
2024-02-18
5.0.1.1339
2024-02-13
5.0.1.1338
2024-02-12
5.0.1.1336
2024-02-11
5.0.1.1335
2024-02-10
5.0.1.1332
2024-02-07
5.0.1.1331
2024-02-04
5.0.1.1330
2024-02-03
5.0.1.1329
2024-02-02
Test TITLE
1 CS 48222 30862 40337 38952 41294 52499 47048 47797 40998 50176 40776 39383 48304 50423 43445 53256 41703 43316 49587 48709 51916 53331 51063 48141 46190 45009 50410 56923 54519 56324 55234
Wrong results or unexpected errors while sorting a large data set
2 CS 18652 18707 18451 18387 18557 18558 18519 18536 18455 18438 18581 18663 18527 18592 18398 18543 18585 18641 18693 18797 19432 18748 18816 20110 19141 19931 19035 18784 19129 19035 18994
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
3 CS 7690 7414 7030 6713 7260 7022 7096 6871 7386 8983 9834 8929 9084 10507 10666 10876 10549 11289 10762 6620 7092 7497 7490 7444 8598 8449 8904 7065 7429 7883 8423
Slow changes on domain
4 SS 7580 6387 6433 6359 6799 6648 6299 6262 6825 8890 9078 8420 8441 10370 10252 10207 14003 10115 13824 6285 6653 6798 7267 7644 7580 7945 7830 7580 6729 7882 7504
Slow changes on domain
5 SS 3966 3671 3988 3580 3843 4023 3819 3758 3777 3930 3795 3721 3957 3759 4036 3976 3867 3756 3919 3820 4483 4723 4427 5697 4585 5408 5833 5726 4828 5701 5336
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
6 SS 430 406 361 376 422 375 418 440 407 457 431 383 434 403 415 430 428 403 395 383 548 571 584 556 495 509 535 558 464 566 536
garbage collection in indexes and blobs is not performed in VIO_backout
7 CS 6678 6678 6603 6616 5703 6605 6643 6629 6754 6638 6713 70064 69162 69242 13777 13727 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
8 SS 7004 6013 5973 7038 7083 6116 7004 6188 6087 6061 6065 68456 69609 68495 13166 13247 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5602
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7747

=== end of list ===