0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (27 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (498 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (4442 rows)
9. All tests: durations (4453 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 26.09.2021 21:17
Tested: FB40.   Build: 4.0.1.2618;   SS: 26.09.21 18:10:18 - 26.09.21 19:40:30;   CS: 26.09.21 19:43:28 - 26.09.21 21:14:07;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 4.0.1.2618
2021-09-26
4.0.1.2613
2021-09-21
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-16
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-29
4.0.1.2573
2021-08-27
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
4.0.1.2567
2021-08-10
4.0.1.2565
2021-08-09
4.0.1.2564
2021-08-08
4.0.1.2563
2021-08-07
4.0.1.2558
2021-08-05
4.0.1.2556
2021-08-03
4.0.1.2555
2021-08-01
4.0.1.2554
2021-07-31
Test TITLE
1 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Privileges of dynamic statements in SP
2 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Grants don't work for procedures used inside views
3 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Can't create table using long username and UTF8 as attachment charset
5 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
6 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Recursive stored procedure shouldnt require execute right to call itself
7 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
8 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
9 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
10 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
11 CS P P     F     P P P     F     P P P P P P P     F     P X P P P P P     F         F     P     F     P P P P
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
12 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
with caller privileges option do not work with autonomous transaction option
13 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
role not passed on external execute stmt
14 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Duplicate tags for CREATE/ALTER USER not handled correctly
15 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 SS P P P P P     E     P P P P P P P P P P P P P P P P P P P     F     P P P P
ISQL 'SHOW DATABASE' command does not show encryption status of database
18 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
SEC$ tables and tag/attributes
19 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
20 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
error read permission for BLOB field, when it is input/output procedure`s parametr
21 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
USING PLUGIN clause does not work in RECREATE USER
22 CS P P P P P P P P P P P P P P     F     X X X X X X X X X X X X X X X
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
23 CS P P P P     F         F     P P P P P P P P P P X P P P P P P P P P P P P P
ISQL - SHOW DATABASE
24 SS P P P P     F         F     P P P P P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE
25 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
GTCS/tests/CF_ISQL_34. minimum-grant-test
26 CS P P P P P     F     P P P P P P P P P P X P P P P P P P P P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
27 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.1.2618
2021-09-26
4.0.1.2613
2021-09-21
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-16
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-29
4.0.1.2573
2021-08-27
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
4.0.1.2567
2021-08-10
4.0.1.2565
2021-08-09
4.0.1.2564
2021-08-08
4.0.1.2563
2021-08-07
4.0.1.2558
2021-08-05
4.0.1.2556
2021-08-03
4.0.1.2555
2021-08-01
4.0.1.2554
2021-07-31
Test TITLE
1 CS 2339 2359 2410 2269 2230 2259 910 2219 2230 2390 2309 2349 2180 2379 2620 2170 2349 2339 2409 2140 2190 2140 2339 2000 2359 2399 2349 2429 2419 2410
Privileges of dynamic statements in SP
2 CS 1940 2080 1940 1830 2079 2040 1060 1820 1930 1970 1889 1970 2149 1859 1859 1880 2089 2069 1889 2009 1899 2009 2099 2019 1990 1889 2119 1860 1830 1900
Grants don't work for procedures used inside views
3 SS 2314 2370 2269 2470 2369 2000 69 2380 2259 2359 2549 2529 2150 2299 2000 2269 2200 2460 2319 2279 2329 2380 2529 2309 2440 2240 2299 2140 2220 2390 2319
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS 1579 1700 1580 1680 1590 1579 1190 1530 1560 1659 1480 1569 1480 1509 1640 1549 1659 1649 1519 1679 1589 1559 1509 1519 1660 1539 1659 1409 1619 1640
Can't create table using long username and UTF8 as attachment charset
5 CS 1350 1369 1310 1419 1430 1379 1219 1289 1450 1379 1000 1190 1449 1390 1350 1329 1369 1309 1269 1450 1329 1000 1330 1269 1360 1319 1350 1240 1360 1419
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
6 CS 2429 2380 2429 2409 2519 2529 1009 2470 2609 2329 2409 2549 2289 2289 2460 2319 2460 2470 2670 2409 2710 2480 2289 2450 2380 2399 2480 2210 3429 2259
Recursive stored procedure shouldnt require execute right to call itself
7 CS 2370 2529 2000 2549 2360 2919 17029 2340 2470 2159 2330 2529 2370 2259 2869 2349 2320 2529 2369 2299 2480 2470 2259 2289 2279 2470 2479 2450 2299 2379
Ability to cancel waiting in lock manager
8 SS 2204 3170 3420 3000 3289 3230 17319 3309 3210 2109 2119 2119 2150 2120 3180 2029 2099 2170 2240 3019 2189 2109 3220 3049 2220 2029 3159 1900 2049 1910 2079
Ability to cancel waiting in lock manager
9 CS 1839 1850 1819 1859 1759 1919 1259 1889 1730 1780 1809 1700 1000 2160 1800 1950 1690 1719 2000 1839 1859 1850 1000 1859 1789 1819 1910 1960 1940 1900
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
10 CS 2150 2150 2000 2269 2450 2279 969 2149 2269 2039 2009 2130 2200 2409 2300 2089 2299 2160 2119 2130 2139 2230 2150 2240 2019 2170 2059 2299 2259 2059
Extend syntax for ALTER USER CURRENT_USER
11 CS 1149 1210 1049 1140 1139 1170 1160 1089 1230 1080 1200 1099 1089 1210 1130 1060 1150 1210 1160 1150 1210 1189 1129 1060 1170 1109 1110 1149 1309 1099
Server crashes during prepare or throws incorrect parsing error if the remotely passed SQL query is empty
12 CS 1829 1740 1939 2129 1890 2079 990 1870 1900 1860 1859 1829 1860 1680 2359 1759 1779 1909 1780 1859 1730 1850 1789 1740 1829 1850 1670 1700 1689 1769
with caller privileges option do not work with autonomous transaction option
13 CS 1730 1639 1880 1000 1819 1879 960 1710 1720 1710 1730 1000 1730 1619 1780 1720 1860 1660 1839 1740 1759 1740 1720 1000 1720 1769 1650 1880 1880 1769
role not passed on external execute stmt
14 CS 1530 1539 1559 1690 1559 1609 809 1530 1779 1669 1440 1509 1769 1470 1539 1629 1000 1380 1460 1490 1479 1000 1430 1539 1780 1490 1440 1480 1730 1609
Duplicate tags for CREATE/ALTER USER not handled correctly
15 CS 1740 1789 1879 1710 1779 1769 1670 1940 1720 1719 1819 1000 1740 1809 1779 1659 1690 1000 1730 1000 1850 1970 1829 1649 1809 1660 1690 1899 1000 1809
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
16 SS 1299 1230 1509 1409 1460 1370 1419 1289 1379 1240 1639 1320 1290 1369 1289 1310 1299 1280 1000 1189 1300 1540 1319 1299 1240 1409 1000 1309 1299 1269 1269
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
17 SS 4470 4599 4609 4579 4429 4509 10 4559 4559 4479 4480 4000 4450 4539 4470 4440 4519 4430 4529 4380 4429 4470 4440 4490 4539 4420 4720 4000 4339 4370 4460
ISQL 'SHOW DATABASE' command does not show encryption status of database
18 CS 1160 1099 1490 1269 1159 1220 829 1129 1330 1160 1000 1140 1210 1109 1140 1269 1330 1309 1399 1099 1110 1129 1139 1180 1289 1130 1180 1490 1460 1140
SEC$ tables and tag/attributes
19 CS 1289 1279 1380 1410 1359 1269 860 1200 1210 1309 1220 1290 1289 1170 1220 1420 1399 1369 1409 1450 1240 1230 1219 1320 1000 1300 1279 1359 1269 1400
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
20 CS 2060 2329 2279 2099 2069 2200 1049 1970 2399 2019 2089 2000 2200 2150 2240 1890 2089 2179 2069 2039 1980 2050 2029 2029 2029 2019 2060 2099 2039 1980
error read permission for BLOB field, when it is input/output procedure`s parametr
21 CS 1370 1370 1640 1379 1390 1530 970 1420 1339 1349 1410 1580 1370 1360 1490 1310 1319 1360 1620 1540 1360 1309 1369 1339 1669 1350 1390 1590 1659 1370
USING PLUGIN clause does not work in RECREATE USER
22 CS 3549 3460 3779 3729 3660 3619 3630 3459 3789 3230 3509 3440 3559 3470 3549 3389
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
23 CS 695 709 680 700 759 700 690 720 730 669 670 740 690 700 680 690 0 690 909 710 659 730 669 670 660 709 650 649 720 719
ISQL - SHOW DATABASE
24 SS 670 710 709 690 700 720 730 710 620 679 639 640 740 630 0 670 630 639 680 619 730 649 629 650 680 609 670 649 649 669 670
ISQL - SHOW DATABASE
25 CS 1799 1000 2180 1629 1860 1759 1139 1840 1759 1650 1799 1679 1920 1769 1980 1789 1919 1809 2099 1860 1710 1680 1919 1740 1940 1690 1900 1980 1880 1740
GTCS/tests/CF_ISQL_34. minimum-grant-test
26 CS 4079 4110 5559 4129 5119 4359 1950 3809 4730 4099 3799 3920 4310 3980 3870 3920 4399 4480 4920 4079 4059 4269 3949 3870 4590 3870 3889 4589 3920 4049
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
27 SS 3774 4069 3779 3849 3809 3889 1309 3930 3699 3930 3700 3930 3870 3650 3850 3670 3839 3799 3770 3569 3740 3709 3799 3839 3859 3519 3700 3720 3769 3570 3599
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1291
http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-2729
http://tracker.firebirdsql.org/browse/core-3242
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-3360
http://tracker.firebirdsql.org/browse/core-3365
http://tracker.firebirdsql.org/browse/core-3554
http://tracker.firebirdsql.org/browse/core-3799
http://tracker.firebirdsql.org/browse/core-4054
http://tracker.firebirdsql.org/browse/core-4464
http://tracker.firebirdsql.org/browse/core-4766
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5162
http://tracker.firebirdsql.org/browse/core-5827
http://tracker.firebirdsql.org/browse/core-5982
http://tracker.firebirdsql.org/browse/core-6083
http://tracker.firebirdsql.org/browse/core-805
http://tracker.firebirdsql.org/browse/core-927
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/minimum-grant-test.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/dml-privileges-sufficiency.fbt
https://github.com/FirebirdSQL/firebird/issues/6935

=== end of list ===