0. Total results for each kind of outcome and server mode
[CURRENT] 1. ERRORS MAP: distribution of Firebird errors which occured during runs (40 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
5. Has fails: tests with at least one fail for previous runs (50 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (27 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (2215 rows)
9. All tests: durations (4332 rows)
A. Skipped: tests which was intentionally excluded from execution (8 rows)

Generated 07.03.2021 11:29
Tested (major version): FB40
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Standard Firebird errors during runs
NN FB-related errors Test name mode 4.0.0.2382
2021-03-07
4.0.0.2379
2021-03-03
4.0.0.2378
2021-03-02
4.0.0.2377
2021-03-01
4.0.0.2375
2021-02-26
4.0.0.2374
2021-02-25
4.0.0.2372
2021-02-23
4.0.0.2371
2021-02-20
4.0.0.2370
2021-02-19
4.0.0.2369
2021-02-18
4.0.0.2366
2021-02-16
4.0.0.2365
2021-02-14
4.0.0.2364
2021-02-05
4.0.0.2361
2021-02-04
4.0.0.2357
2021-02-02
4.0.0.2353
2021-01-31
4.0.0.2349
2021-01-29
4.0.0.2345
2021-01-28
4.0.0.2342
2021-01-27
4.0.0.2341
2021-01-25
4.0.0.2337
2021-01-23
4.0.0.2336
2021-01-22
4.0.0.2335
2021-01-21
4.0.0.2332
2021-01-20
4.0.0.2325
2021-01-13
4.0.0.2324
2021-01-09
4.0.0.2317
2021-01-08
4.0.0.2315
2021-01-01
4.0.0.2313
2020-12-31
4.0.0.2308
2020-12-29
Test TITLE
1 cancelled; net_read_err; net_write_err CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
2 cancelled; net_read_err; net_write_err SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Timeout for running SQL statement (SET STATEMENT TIMEOUT <N>)
3 dsql_error; no_meta_update; table_name; rec_size_err,SQLERR 309 : new record size of @1 bytes is too big; sqlerr; dsql_relation_err; dsql_line_col_error CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Add better transaction control to isql
4 dsql_error; no_meta_update; table_name; rec_size_err,SQLERR 309 : new record size of @1 bytes is too big; sqlerr; dsql_relation_err; dsql_line_col_error SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Add better transaction control to isql
5 dyn_index_not_found; dsql_drop_index_failed; keytoobig,SQLERR 336 : key size exceeds implementation restriction for index "@1"; no_meta_update; expression_eval_index; NOT_FOUND CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Add expression index name to exception message if computation failed
6 dyn_index_not_found; dsql_drop_index_failed; keytoobig,SQLERR 336 : key size exceeds implementation restriction for index "@1"; no_meta_update; expression_eval_index; NOT_FOUND SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Add expression index name to exception message if computation failed
7 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
8 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
ISQL input command (or -i option) reads large (> 64K) lines incorrectly
9 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
10 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-01
11 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
12 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
13 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
14 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.
15 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
16 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-01.
17 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
18 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-02.
19 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
20 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-03.
21 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
22 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
23 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
24 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-02.
25 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
26 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-03.
27 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
28 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-01.
29 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
30 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-02.
31 net_read_err CS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
32 net_read_err SS P P P P P P P P P P P P P P P P     E     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
33 net_read_err; net_write_err CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Maximal number of statement-level restarts must be 10.
34 net_read_err; net_write_err SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Maximal number of statement-level restarts must be 10.
35 net_read_err; net_write_err CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-04.
36 net_read_err; net_write_err SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by DELETE. Test-04.
37 net_read_err; net_write_err CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-04.
38 net_read_err; net_write_err SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-04.
39 net_read_err; net_write_err CS P P P P P P P P P P P P P P     F     P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-04.
40 net_read_err; net_write_err SS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-04.

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-4882
http://tracker.firebirdsql.org/browse/core-4933
http://tracker.firebirdsql.org/browse/core-5488
http://tracker.firebirdsql.org/browse/core-5606
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-statement-delete-undone-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-statement-delete-undone-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-merge-deny-multiple-matches.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-max-limit.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-delete-04.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-merge-04.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-02.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/transactions/read-consist-sttm-restart-on-update-04.fbt

=== end of list ===