0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (42 rows)
5. Has fails: tests with at least one fail for previous runs (52 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (285 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (5 rows)
8. All tests: outcomes (2058 rows)
9. All tests: durations (3778 rows)
A. Skipped: tests which was intentionally excluded from execution (3 rows)

Generated 02.03.2021 11:11
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Tests which fail for at least two last runs:
NN Test name mode 3.0.8.33421
2021-03-02
3.0.8.33420
2021-03-01
3.0.8.33418
2021-02-18
3.0.8.33416
2021-02-16
3.0.8.33415
2021-02-15
X X X X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Domain names and charset issues
2 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
3 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Greek characters in cp1251 vs uppercasing
4 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Greek characters in cp1251 vs uppercasing
5 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
6 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
7 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
8 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
CREATE COLLATION connection lost under Posix
9 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
10 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
11 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Inserting K?se into a CHARACTER SET ASCII column succeeds
12 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Inserting K?se into a CHARACTER SET ASCII column succeeds
13 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Blob transliteration may not happen inside the union
14 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Blob transliteration may not happen inside the union
15 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
EXECUTE BLOCK execution cause server crash
16 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
EXECUTE BLOCK execution cause server crash
17 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Metadata source becomes wrong after twice transliteration to the metadata charset
18 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Metadata source becomes wrong after twice transliteration to the metadata charset
19 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
20 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
21 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
error on create table with "CHARACTER SET DOS775" field
22 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
error on create table with "CHARACTER SET DOS775" field
23 CS     F         F         E         E         E     X X X X X X X X X X X X X X X X X X X X X X X X X
Online validation during DML activity in other connection leads to message "Error while trying to read from file" and "page in use during flush (210), file: cch.cpp line: 2672"
24 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
25 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
26 SS     F         F         E         E         E     X X X X X X X X X X X X X X X X X X X X X X X X X
Sometime it is impossible to cancel\kill connection executing external query
27 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Field name max length check wrongly if national characters specified
28 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Field name max length check wrongly if national characters specified
29 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
30 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
31 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
32 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
33 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
34 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
35 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
INNER JOIN join order
36 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
INNER JOIN join order
37 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
38 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
39 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
test for LPAD function
40 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
test for LPAD function
41 CS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
test for RPAD function
42 SS     F         F         F         F         F     X X X X X X X X X X X X X X X X X X X X X X X X X
test for RPAD function

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33421
2021-03-02
3.0.8.33420
2021-03-01
3.0.8.33418
2021-02-18
3.0.8.33416
2021-02-16
3.0.8.33415
2021-02-15
X X X X X X X X X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 399 399 420 399 399 410
Domain names and charset issues
2 SS 740 0 700 740 759 0
LIKE doesn't work correctly with collations using SPECIALS-FIRST=1
3 CS 1200 1210 1190 1200 1289 1169
Greek characters in cp1251 vs uppercasing
4 SS 1009 909 919 1009 1369 1049
Greek characters in cp1251 vs uppercasing
5 CS 1139 1289 1129 1139 1180 1130
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
6 SS 880 880 1079 880 869 920
select * from rdb$triggers where rdb$trigger_source like 'CHECK%'
7 CS 740 699 730 929 789 740
CREATE COLLATION connection lost under Posix
8 SS 549 539 509 549 690 590
CREATE COLLATION connection lost under Posix
9 CS 1369 1380 1369 1340 1369 1240
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
10 SS 1070 1119 1009 1069 1150 1070
Exception when upper casing string with lowercase y trema (code 0xFF in ISO8859_1 )
11 CS 1019 1019 1019 1059 980 1040
Inserting K?se into a CHARACTER SET ASCII column succeeds
12 SS 860 1089 859 860 869 790
Inserting K?se into a CHARACTER SET ASCII column succeeds
13 CS 809 809 840 819 780 779
Blob transliteration may not happen inside the union
14 SS 534 549 480 520 0 759
Blob transliteration may not happen inside the union
15 CS 6609 6680 6609 8190 6400 6079
EXECUTE BLOCK execution cause server crash
16 SS 5839 5960 5529 5670 5839 6180
EXECUTE BLOCK execution cause server crash
17 CS 920 920 909 1009 939 910
Metadata source becomes wrong after twice transliteration to the metadata charset
18 SS 725 0 720 680 789 730
Metadata source becomes wrong after twice transliteration to the metadata charset
19 CS 760 730 740 769 760 809
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
20 SS 525 540 509 549 510 0
Firebird crash when executing an stored procedure called by a trigger that converts string to upper
21 CS 769 820 779 769 769 759
error on create table with "CHARACTER SET DOS775" field
22 SS 519 509 539 529 519 519
error on create table with "CHARACTER SET DOS775" field
23 CS 879 10410 10960 879 849 829
Online validation during DML activity in other connection leads to message "Error while trying to read from file" and "page in use during flush (210), file: cch.cpp line: 2672"
24 CS 754 1540 0 769 740 730
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
25 SS 529 519 529 509 600 539
Creating SRP SYSDBA with explicit admin (-admin yes in gsec or grant admin role in create user) creates two SYSDBA accounts
26 SS 970 133269 133339 919 970 869
Sometime it is impossible to cancel\kill connection executing external query
27 CS 740 730 799 740 740 829
Field name max length check wrongly if national characters specified
28 SS 519 559 480 509 539 519
Field name max length check wrongly if national characters specified
29 CS 1039 1039 1729 980 1060 1019
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
30 SS 774 780 690 0 769 960
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
31 CS 879 1049 810 879 879 860
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
32 SS 670 1019 639 670 660 740
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
33 CS 804 769 839 879 0 710
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
34 SS 509 589 509 509 0 490
Srp plugin keeps connection after database has been removed for ~10 seconds (SS and SC).
35 CS 4529 5259 4529 4460 4419 4610
INNER JOIN join order
36 SS 4129 4129 4060 4039 4190 4289
INNER JOIN join order
37 CS 2299 2370 2299 2410 2180 2200
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
38 SS 1880 1880 1880 1910 1929 1870
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
39 CS 659 609 700 609 659 670
test for LPAD function
40 SS 419 419 399 389 419 419
test for LPAD function
41 CS 639 600 650 650 610 639
test for RPAD function
42 SS 379 389 399 370 379 379
test for RPAD function

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1378
http://tracker.firebirdsql.org/browse/core-1384
http://tracker.firebirdsql.org/browse/core-1431
http://tracker.firebirdsql.org/browse/core-1539
http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-2912
http://tracker.firebirdsql.org/browse/core-3416
http://tracker.firebirdsql.org/browse/core-3489
http://tracker.firebirdsql.org/browse/core-4115
http://tracker.firebirdsql.org/browse/core-4119
http://tracker.firebirdsql.org/browse/core-4123
http://tracker.firebirdsql.org/browse/core-4276
http://tracker.firebirdsql.org/browse/core-4855
http://tracker.firebirdsql.org/browse/core-5496
http://tracker.firebirdsql.org/browse/core-5685
http://tracker.firebirdsql.org/browse/core-5802
http://tracker.firebirdsql.org/browse/core-5876
http://tracker.firebirdsql.org/browse/core-5926
http://tracker.firebirdsql.org/browse/core-6441
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/external-file-06-d.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/string/lpad_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/string/rpad_01.fbt

=== end of list ===