0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (19 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (47 rows)
5. Has fails: tests with at least one fail for previous runs (69 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (289 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (251 rows)
8. All tests: outcomes (2040 rows)
9. All tests: durations (3734 rows)
A. Skipped: tests which was intentionally excluded from execution (3 rows)

Generated 23.02.2021 12:27
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Tests which fail for at least two last runs:
NN Test name mode 3.0.8.33415
2021-02-23
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Containing not working correctly
2 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Containing not working correctly
3 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Domain names and charset issues
4 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Domain names and charset issues
5 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
6 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
7 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Greek characters in cp1251 vs uppercasing
8 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Greek characters in cp1251 vs uppercasing
9 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
10 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
11 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
12 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
13 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
14 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
15 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
16 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
17 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Inserting K?se into a CHARACTER SET ASCII column succeeds
18 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Inserting K?se into a CHARACTER SET ASCII column succeeds
19 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Blob transliteration may not happen inside the union
20 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Blob transliteration may not happen inside the union
21 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
EXECUTE BLOCK execution cause server crash
22 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
EXECUTE BLOCK execution cause server crash
23 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Metadata source becomes wrong after twice transliteration to the metadata charset
24 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Metadata source becomes wrong after twice transliteration to the metadata charset
25 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
26 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
27 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
error on create table with "CHARACTER SET DOS775" field
28 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
error on create table with "CHARACTER SET DOS775" field
29 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
30 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
31 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
32 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Field name max length check wrongly if national characters specified
33 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Field name max length check wrongly if national characters specified
34 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
35 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
36 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
37 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
38 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
39 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
40 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
INNER JOIN join order
41 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
INNER JOIN join order
42 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
43 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
44 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
test for LPAD function
45 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
test for LPAD function
46 CS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
test for RPAD function
47 SS     F         F     X X X X X X X X X X X X X X X X X X X X X X X X X X X X
test for RPAD function

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33415
2021-02-23
3.0.8.33403
2021-02-08
X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 1279 1289 1269
Containing not working correctly
2 SS 930 920 940
Containing not working correctly
3 CS 725 720 730
Domain names and charset issues
4 SS 434 420 449
Domain names and charset issues
5 CS 1040 1080 1000
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
6 SS 709 699 719
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
7 CS 1319 1340 1299
Greek characters in cp1251 vs uppercasing
8 SS 899 930 869
Greek characters in cp1251 vs uppercasing
9 CS 1105 1000 1210
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
10 SS 1104 1299 910
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
11 CS 899 909 889
CREATE COLLATION connection lost under Posix
12 SS 569 579 559
CREATE COLLATION connection lost under Posix
13 CS 2639 2640 2639
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
14 SS 2329 2340 2319
The famous "cannot transliterate" error may be thrown when selecting data from the monitoring tables
15 CS 1789 2039 1539
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
16 SS 1104 1039 1170
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
17 CS 1129 1129 1130
Inserting K?se into a CHARACTER SET ASCII column succeeds
18 SS 804 779 829
Inserting K?se into a CHARACTER SET ASCII column succeeds
19 CS 879 889 870
Blob transliteration may not happen inside the union
20 SS 1159 1159 0
Blob transliteration may not happen inside the union
21 CS 7174 8349 6000
EXECUTE BLOCK execution cause server crash
22 SS 5714 5879 5549
EXECUTE BLOCK execution cause server crash
23 CS 1084 1010 1159
Metadata source becomes wrong after twice transliteration to the metadata charset
24 SS 784 859 710
Metadata source becomes wrong after twice transliteration to the metadata charset
25 CS 904 910 899
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
26 SS 534 529 540
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
27 CS 1024 1180 869
error on create table with "CHARACTER SET DOS775" field
28 SS 529 529 529
error on create table with "CHARACTER SET DOS775" field
29 SS 15690 15420 15960
Performance regression when bulk inserting into table with indices
30 CS 969 980 959
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
31 SS 549 549 549
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
32 CS 1259 1559 960
Field name max length check wrongly if national characters specified
33 SS 559 569 549
Field name max length check wrongly if national characters specified
34 CS 1159 1099 1220
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
35 SS 765 810 720
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
36 CS 990 990 990
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
37 SS 669 680 659
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
38 CS 959 1070 849
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
39 SS 549 509 589
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
40 CS 4500 4630 4370
INNER JOIN join order
41 SS 4135 4270 4000
INNER JOIN join order
42 CS 2219 2000 2439
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
43 SS 1885 1910 1860
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
44 CS 720 0 720
test for LPAD function
45 SS 414 430 399
test for LPAD function
46 CS 834 709 960
test for RPAD function
47 SS 469 430 509
test for RPAD function

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1378
http://tracker.firebirdsql.org/browse/core-1384
http://tracker.firebirdsql.org/browse/core-1431
http://tracker.firebirdsql.org/browse/core-1539
http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-2531
http://tracker.firebirdsql.org/browse/core-2912
http://tracker.firebirdsql.org/browse/core-3416
http://tracker.firebirdsql.org/browse/core-3489
http://tracker.firebirdsql.org/browse/core-4115
http://tracker.firebirdsql.org/browse/core-4119
http://tracker.firebirdsql.org/browse/core-4123
http://tracker.firebirdsql.org/browse/core-4276
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5496
http://tracker.firebirdsql.org/browse/core-5802
http://tracker.firebirdsql.org/browse/core-5876
http://tracker.firebirdsql.org/browse/core-5926
http://tracker.firebirdsql.org/browse/core-6441
http://tracker.firebirdsql.org/browse/core-857
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/external-file-06-d.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/string/lpad_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/string/rpad_01.fbt

=== end of list ===