0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (40 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
5. Has fails: tests with at least one fail for previous runs (50 rows)
[CURRENT] 6. Has runtime errors: tests with at least one runtime error for previous runs (27 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (2215 rows)
9. All tests: durations (4332 rows)
A. Skipped: tests which was intentionally excluded from execution (8 rows)

Generated 07.03.2021 11:29
Tested (major version): FB40
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "ERROR" for last 30 runs:
NN Test name mode 4.0.0.2382
2021-03-07
4.0.0.2379
2021-03-03
4.0.0.2378
2021-03-02
4.0.0.2377
2021-03-01
4.0.0.2375
2021-02-26
4.0.0.2374
2021-02-25
4.0.0.2372
2021-02-23
4.0.0.2371
2021-02-20
4.0.0.2370
2021-02-19
4.0.0.2369
2021-02-18
4.0.0.2366
2021-02-16
4.0.0.2365
2021-02-14
4.0.0.2364
2021-02-05
4.0.0.2361
2021-02-04
4.0.0.2357
2021-02-02
4.0.0.2353
2021-01-31
4.0.0.2349
2021-01-29
4.0.0.2345
2021-01-28
4.0.0.2342
2021-01-27
4.0.0.2341
2021-01-25
4.0.0.2337
2021-01-23
4.0.0.2336
2021-01-22
4.0.0.2335
2021-01-21
4.0.0.2332
2021-01-20
4.0.0.2325
2021-01-13
4.0.0.2324
2021-01-09
4.0.0.2317
2021-01-08
4.0.0.2315
2021-01-01
4.0.0.2313
2020-12-31
4.0.0.2308
2020-12-29
Test TITLE
1 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
2 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
3 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
4 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
5 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
6 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
7 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
8 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
9 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
10 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
11 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
12 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
13 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
14 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
15 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
16 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
17 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
18 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
19 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
20 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
21 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
22 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
23 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
24 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
25 CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
26 SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
27 CS P P P P P P     E     P P P P P P P P P P P P P P P P P P P P P P P
gbak utility: check ability to use -ZIP command switch when create backup

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.0.2382
2021-03-07
4.0.0.2379
2021-03-03
4.0.0.2378
2021-03-02
4.0.0.2377
2021-03-01
4.0.0.2375
2021-02-26
4.0.0.2374
2021-02-25
4.0.0.2372
2021-02-23
4.0.0.2371
2021-02-20
4.0.0.2370
2021-02-19
4.0.0.2369
2021-02-18
4.0.0.2366
2021-02-16
4.0.0.2365
2021-02-14
4.0.0.2364
2021-02-05
4.0.0.2361
2021-02-04
4.0.0.2357
2021-02-02
4.0.0.2353
2021-01-31
4.0.0.2349
2021-01-29
4.0.0.2345
2021-01-28
4.0.0.2342
2021-01-27
4.0.0.2341
2021-01-25
4.0.0.2337
2021-01-23
4.0.0.2336
2021-01-22
4.0.0.2335
2021-01-21
4.0.0.2332
2021-01-20
4.0.0.2325
2021-01-13
4.0.0.2324
2021-01-09
4.0.0.2317
2021-01-08
4.0.0.2315
2021-01-01
4.0.0.2313
2020-12-31
4.0.0.2308
2020-12-29
Test TITLE
1 CS 4064 3940 4389 3990 4059 4029 4170 4450 4069 4490 4019 4009 4069 3980 4039 3960 3900 6680 3920 4000 3920 4190 4189 4470 4440 5009 4090 3039 4039 4210 4349
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
2 SS 4185 4029 4110 4170 4129 3950 4170 4210 4019 4070 4090 4340 4380 4200 4610 4350 4269 7759 4459 4220 4590 4279 4000 4300 3839 4149 4450 3080 4570 3980 4019
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
3 CS 6509 6440 6509 6490 6690 6509 6639 6799 6470 6560 6620 6680 6429 6509 6000 6420 6000 6350 6480 6710 6730 6520 6599 6880 6530 6490 6480 4000 6439 6859 6730
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
4 SS 5624 5630 5670 5720 5720 5690 5789 5570 5599 5680 5659 5649 5000 5619 5619 5660 5730 6210 5720 5660 5740 5509 5440 5479 5360 5359 5339 3569 5379 5410 5370
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
5 CS 6439 6809 6329 6910 6959 6590 6920 6670 6319 6399 6399 6470 6810 6400 6329 6980 6409 6389 6939 6429 6519 6449 6450 6779 6069 6300 6349 4259 6490 6029 6299
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
6 SS 5559 5529 5579 5700 5660 5539 5819 5639 5569 5599 5540 5590 5429 5610 5580 5569 5579 6140 5549 5649 5620 5490 5309 5310 5329 5300 5279 3579 5329 5329 5329
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
7 CS 10980 10080 10150 11019 10630 10220 10649 10379 10940 11009 11090 11109 11099 11079 10980 11450 11069 17120 11170 10980 11890 11130 10870 11259 10680 10609 11099 7189 10970 10970 10640
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
8 SS 9159 8339 8519 8419 8410 8410 8640 9549 9360 9340 9309 9389 9090 9259 9299 9369 9519 6199 9359 9420 9339 9319 9230 9159 9149 9159 9080 6460 8980 9090 9000
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
9 CS 9660 10019 9399 10170 10400 9859 10139 10029 10009 9790 9230 9390 9539 10050 9400 10050 9759 6669 9680 9809 9789 9640 9539 9420 9940 9000 9570 6380 9000 9529 9399
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
10 SS 8309 8319 8350 8490 8410 8319 8430 8579 8000 8300 8389 8430 8150 8670 8339 8279 8409 6230 8269 8339 8380 8230 7969 8100 8779 7980 8009 5480 7950 8019 7930
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
11 CS 9669 9679 9470 9919 9859 10029 9799 10519 9789 10079 9710 9359 9740 9659 9759 9769 9640 7140 9559 9650 9759 9539 9000 9409 9890 9430 9529 6139 9399 8910 9740
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
12 SS 8309 8309 8419 8519 8440 8420 8480 8460 8229 8240 8260 9450 8299 8599 8309 8309 8279 6480 8380 8450 8419 8119 8510 7990 7990 8000 9120 5619 7859 7930 8309
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
13 CS 10715 10890 10620 10720 10900 12000 10720 11000 10710 10649 10769 11029 10759 10660 10599 10929 10769 7429 10740 11109 11529 10220 10850 10000 10359 9699 10490 6920 10300 10409 10480
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
14 SS 9269 9269 9290 9349 9460 9439 9490 9299 9309 9239 9799 9269 9319 9200 9339 9889 9260 6610 9359 9410 9980 9100 8779 8899 8859 8849 8990 6180 8900 8919 8810
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
15 CS 9579 10059 10409 9899 10309 9599 9890 10559 9370 9569 9300 9519 9690 9650 9589 9630 9000 6509 9760 9540 9600 9490 9670 9439 9000 9619 8769 6240 9470 9400 9049
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
16 SS 8279 8269 8350 8000 9009 8350 8610 8369 8450 8259 8289 8440 8360 8259 8319 8609 8470 6159 8310 8289 8379 8100 8019 7950 7970 7980 7880 5440 7880 7970 7980
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
17 CS 9584 9690 9390 9870 10210 10480 9000 10140 9589 9579 9329 9850 9670 9919 9710 10000 9589 6230 9549 10059 9960 9519 9589 9370 9519 9240 9450 6339 9330 9559 9420
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
18 SS 8309 8460 8430 8509 8349 8489 8480 8529 8299 8279 8299 8470 8230 8240 8440 8370 8480 6140 8319 8470 8610 8230 8080 7989 7960 8039 8079 5450 7940 8470 7980
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
19 CS 10680 10589 10480 10690 10710 10700 11539 10980 10819 10650 10539 10639 10980 10700 11170 10899 10609 7209 10720 10609 11000 10730 10670 10839 10710 10380 9929 7210 10429 10450 10119
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
20 SS 9264 9730 9549 9369 9600 9820 9589 9630 9130 9000 9340 9279 9269 9230 9259 9359 9299 6609 9460 9230 9389 9179 8849 8840 9220 8940 9160 5929 8799 8940 9519
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
21 CS 9680 10029 9680 9820 10009 9730 9000 10079 9759 9799 9379 9519 9610 9680 9640 9909 9839 7180 9700 9000 9849 9730 9679 9920 9600 9620 8809 6019 9470 10230 9460
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
22 SS 8329 8270 8590 9450 8579 8439 8649 8449 8339 8320 8470 8320 8389 8350 8399 8309 8490 6140 8369 8309 8359 8259 7879 8149 8360 8199 7970 5000 7960 8019 8029
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
23 CS 9649 9769 9409 10219 9959 10000 9960 10109 9359 9660 9440 9980 9679 9819 9910 9000 9800 7190 9679 9600 9809 9259 9610 9460 9609 9559 10319 6079 9610 9639 9539
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
24 SS 8354 8839 8559 9089 8670 8000 8430 8460 8269 8389 8350 8230 8400 8409 8269 8529 8359 6129 8619 8920 8930 8629 8029 7960 7980 8070 8019 5459 7940 8029 8089
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
25 CS 9705 9690 9789 9740 10269 10099 10119 10060 9759 9689 9640 9600 9810 9529 9720 9660 9730 6189 9759 10089 9770 9680 9579 9509 9870 9599 9279 6550 9619 9410 9730
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
26 SS 8359 8389 8359 8600 8589 8509 9559 8430 8560 8339 8419 8369 8289 8350 8360 8359 8410 6150 8950 8639 8619 8279 8570 8130 8089 8009 8119 5519 8029 8100 8009
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
27 CS 7519 8370 12430 12099 12600 9569 9789 9890 7380 7549 7600 7490 7200 7009 7110 7620 7139 10079 7559 8059 7590 7669 7150 7000 7110 7039 6990 4220 7169 6910 6899
gbak utility: check ability to use -ZIP command switch when create backup

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-4882
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-statement-delete-undone-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-statement-delete-undone-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-merge-deny-multiple-matches.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/util/gbak_zip.fbt

=== end of list ===