0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (36 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (42 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (8 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (1 rows)
8. All tests: outcomes (2290 rows)
9. All tests: durations (4510 rows)
A. Skipped: tests which was intentionally excluded from execution (5 rows)

Generated 27.09.2021 00:40
Tested: FB40.   Build: 4.0.1.2618;   SS: 26.09.21 20:14:26 - 26.09.21 22:29:18;   CS: 26.09.21 22:32:35 - 27.09.21 00:37:54;
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 4.0.1.2618
2021-09-27
4.0.1.2613
2021-09-22
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-15
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-28
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
4.0.1.2567
2021-08-10
4.0.1.2565
2021-08-09
4.0.1.2564
2021-08-08
4.0.1.2563
2021-08-07
4.0.1.2558
2021-08-05
4.0.1.2556
2021-08-03
4.0.1.2555
2021-08-01
4.0.1.2554
2021-07-31
4.0.1.2547
2021-07-29
Test TITLE
1 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Privileges of dynamic statements in SP
2 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Privileges of dynamic statements in SP
3 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Grants don't work for procedures used inside views
4 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Grants don't work for procedures used inside views
5 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Can't create table using long username and UTF8 as attachment charset
6 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Can't create table using long username and UTF8 as attachment charset
7 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
8 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
9 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Recursive stored procedure shouldnt require execute right to call itself
10 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Recursive stored procedure shouldnt require execute right to call itself
11 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
12 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
13 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
14 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
15 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
16 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Extend syntax for ALTER USER CURRENT_USER
17 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
with caller privileges option do not work with autonomous transaction option
18 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
with caller privileges option do not work with autonomous transaction option
19 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
role not passed on external execute stmt
20 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
role not passed on external execute stmt
21 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Duplicate tags for CREATE/ALTER USER not handled correctly
22 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Duplicate tags for CREATE/ALTER USER not handled correctly
23 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
24 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
25 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
SEC$ tables and tag/attributes
26 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
SEC$ tables and tag/attributes
27 CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
28 SS P P P P P P P P P P P P P P P P     F     P P     F     P P P P     F     P P P P P
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
29 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
30 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
31 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
error read permission for BLOB field, when it is input/output procedure`s parametr
32 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
error read permission for BLOB field, when it is input/output procedure`s parametr
33 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
USING PLUGIN clause does not work in RECREATE USER
34 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
USING PLUGIN clause does not work in RECREATE USER
35 CS P P P P P P P P P P P P P P     F     X X X X X X X X X X X X X X X
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
36 CS P P P P     F         F     P P P P P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE
37 SS P P P P     F         F     P P P P P P P P P P P P P P P P P P P P P P P P
ISQL - SHOW DATABASE
38 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
GTCS/tests/CF_ISQL_34. minimum-grant-test
39 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
GTCS/tests/CF_ISQL_34. minimum-grant-test
40 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F    
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
41 CS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
42 SS P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.1.2618
2021-09-27
4.0.1.2613
2021-09-22
4.0.1.2606
2021-09-20
4.0.1.2605
2021-09-19
4.0.1.2604
2021-09-17
4.0.1.2602
2021-09-16
4.0.1.2592
2021-09-15
4.0.1.2588
2021-09-14
4.0.1.2587
2021-09-10
4.0.1.2586
2021-09-09
4.0.1.2585
2021-09-08
4.0.1.2584
2021-09-07
4.0.1.2580
2021-09-04
4.0.1.2579
2021-09-02
4.0.1.2578
2021-09-01
4.0.1.2577
2021-08-31
4.0.1.2574
2021-08-28
4.0.1.2571
2021-08-20
4.0.1.2570
2021-08-14
4.0.1.2569
2021-08-13
4.0.1.2568
2021-08-12
4.0.1.2567
2021-08-10
4.0.1.2565
2021-08-09
4.0.1.2564
2021-08-08
4.0.1.2563
2021-08-07
4.0.1.2558
2021-08-05
4.0.1.2556
2021-08-03
4.0.1.2555
2021-08-01
4.0.1.2554
2021-07-31
4.0.1.2547
2021-07-29
Test TITLE
1 CS 2000 2020 1980 2050 2029 2040 4460 1980 1970 2000 2000 2000 1980 2000 2100 1980 1970 2029 2059 2069 2000 1990 1949 1970 1969 1980 2000 1980 1980 1980 2000
Privileges of dynamic statements in SP
2 SS 2069 1980 2070 2079 2079 2069 11950 2059 2059 2150 2119 2070 2069 2009 2059 2080 2049 2140 2129 2069 2150 2139 2029 2069 2019 2009 2120 2000 2029 2029 2000
Privileges of dynamic statements in SP
3 CS 2539 2559 2559 2519 2529 2579 3029 2529 2589 2559 2589 2779 2529 2539 2599 2480 2460 2480 2540 2629 2539 2529 2460 2509 2539 2519 2519 2519 2549 2509 2669
Grants don't work for procedures used inside views
4 SS 2880 2869 2869 2890 2939 2900 3289 2899 2869 2849 2920 2890 2910 2930 2900 2789 2899 2860 2850 2910 2890 2869 2859 2900 2839 2920 2870 2860 2819 2859 2870
Grants don't work for procedures used inside views
5 CS 2619 2649 2579 2600 2640 2619 4350 2650 2619 2629 2619 2670 2640 2639 2640 2620 2619 2599 2670 2619 2650 2679 2000 2619 2599 2589 2539 2590 2529 2559 2630
Can't create table using long username and UTF8 as attachment charset
6 SS 2889 2820 2850 2920 2909 2929 3210 2889 2859 2899 2900 2910 2919 2919 2919 2829 2849 2809 2819 2919 2900 2829 2840 2890 2839 2899 2860 2849 2840 2919 2889
Can't create table using long username and UTF8 as attachment charset
7 CS 2370 2359 2419 2430 2349 2349 3069 2430 2359 2350 2349 2369 2349 2349 2350 2370 2400 2400 2460 2369 2380 2389 2370 2390 2359 2370 2359 2389 2400 2400 2339
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
8 SS 2449 2469 2470 2440 2440 2430 3000 2450 2449 2430 2450 2439 2450 2480 2409 2449 2440 2449 2460 2450 2460 2450 2420 2420 2430 2440 2450 2450 2450 2430 2410
Current connection may be used by EXECUTE STATEMENT instead of creation of new attachment
9 CS 3059 3130 3029 3059 3039 3110 4789 3049 3039 3009 3049 3039 3110 3060 3120 3069 3029 3140 3100 3009 3049 3070 3070 3090 3100 3009 3089 3029 3100 3009 3059
Recursive stored procedure shouldnt require execute right to call itself
10 SS 3475 3000 3460 3529 3430 3460 3789 3480 3509 3450 3509 3490 3000 3430 3490 3439 3630 3490 3480 3480 3469 3460 3420 3490 3509 3000 3490 3459 3480 3460 3470
Recursive stored procedure shouldnt require execute right to call itself
11 CS 5205 5299 5000 5099 5509 5339 21159 5109 5490 5120 5079 5070 5230 5029 5329 5089 5159 5180 5340 5210 5210 5240 5400 5309 5089 5200 5310 5149 5370 4959 5090
Ability to cancel waiting in lock manager
12 SS 6160 6149 6019 6160 6099 6160 21450 6210 6210 6089 6220 6139 6210 6029 6200 6179 6160 6269 6149 6160 5990 6240 6010 6209 6129 6129 6180 6240 6179 6190 6000
Ability to cancel waiting in lock manager
13 CS 2980 2980 2939 2940 3009 3069 3599 2990 3079 3009 2940 2970 3000 2929 3000 2960 2889 2980 2980 3089 2930 2980 2980 3000 2980 2990 3039 3089 3009 2930 2950
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
14 SS 3405 3390 3360 3430 3420 3440 3000 3440 3460 3380 3449 3410 3400 3379 3480 3379 3430 3450 3390 3410 3560 3380 3349 3420 3379 3400 3450 3000 3390 3450 3380
update ... returning ... raises -551 (no perm to update) for a column present only in the returning clause
15 CS 3605 3629 3539 3519 3639 3610 3519 3669 3669 3650 3569 3599 3649 3509 3620 3629 3619 3590 3480 3650 3619 3610 3600 3610 3610 3599 3589 3430 3589 3529 3540
Extend syntax for ALTER USER CURRENT_USER
16 SS 3974 3960 3900 3960 3920 3979 3710 4000 4049 3880 4009 4009 3990 3940 3980 3959 4009 4009 3980 3970 3840 4009 3930 3980 3979 3940 3990 3970 3960 4000 3950
Extend syntax for ALTER USER CURRENT_USER
17 CS 2269 2259 2309 2210 2269 2000 3899 2279 2279 2000 2000 2259 2319 2210 2000 2289 2270 2339 2290 2310 2240 2339 2000 2269 2240 2599 2289 2299 2339 2229 2259
with caller privileges option do not work with autonomous transaction option
18 SS 2460 2460 2419 2450 2450 2480 3259 2450 2490 2439 2460 2480 2470 2470 2440 2480 2450 2470 2450 2470 2470 2460 2450 2469 2459 2470 2480 2000 2430 2470 2460
with caller privileges option do not work with autonomous transaction option
19 CS 2319 2319 2319 2279 2400 2420 4899 2340 2299 2389 2279 2299 2330 2319 2319 2319 2320 2279 2319 2339 2330 2340 2329 2319 2319 2310 2309 2289 2280 2319 2289
role not passed on external execute stmt
20 SS 2460 2470 2440 2460 2430 2460 3269 2470 2470 2349 2450 2440 2460 2450 2469 2450 2490 2470 2460 2490 2449 2460 2419 2450 2440 2470 2480 2460 2449 2519 2480
role not passed on external execute stmt
21 CS 1889 1869 1870 1880 1869 1909 3000 1889 1869 1889 1889 1879 1890 1990 1960 1860 1970 1889 1870 2009 1870 1850 1879 1849 1950 1880 1870 1949 1939 1960 1930
Duplicate tags for CREATE/ALTER USER not handled correctly
22 SS 1980 2009 2359 2299 2289 2000 2759 1980 1980 1970 1970 1960 1970 1970 2259 1960 2029 2309 2379 1970 1990 1980 1970 1980 1980 1970 1990 2000 1980 2000 1930
Duplicate tags for CREATE/ALTER USER not handled correctly
23 CS 3509 3000 3529 3609 3460 3569 5879 3519 3480 3509 3519 3519 3620 3519 3519 3460 3609 3509 3480 3549 3450 3480 3509 3479 3479 3529 3000 3509 3460 3509 3539
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
24 SS 2629 2710 2790 2000 2710 2699 4339 2670 2630 2569 2589 2619 2609 2579 2580 2609 2660 2629 2650 2680 2539 2670 2630 2609 2639 2629 2620 2620 2620 2589 2630
AV when trying to manage users list using EXECUTE STATEMENT on behalf of non-sysdba user which has RDB$ADMIN role
25 CS 1809 1809 1829 1789 1800 1799 3740 1849 1809 1799 1779 1779 1799 1779 1849 1789 1829 1809 1809 1839 1809 1810 1809 1829 1810 1799 1850 1789 1839 1789 1779
SEC$ tables and tag/attributes
26 SS 1890 1889 1890 1889 1890 1909 2730 1880 1900 1890 1890 1890 1890 1880 1900 1889 1920 1889 1920 1880 1890 1890 1950 1889 1890 1889 1980 1869 1920 1910 1880
SEC$ tables and tag/attributes
27 CS 3850 3810 3870 3949 3859 3850 3839 3849 3829 3859 4009 3990 3980 3849 3850 3839 3850 3850 3789 3839 3860 3839 3819 3840 3869 3910 3829 3850 3860 3839 3850
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
28 SS 4129 4149 4109 4160 4160 4129 4129 4119 4269 4119 4359 4309 4329 4119 4140 4089 4100 4129 4110 4099 4139 4119 4069 4200 4180 4210 4150 4099 4119 4170 4119
SIMILAR TO is substantially (500-700x) slower than LIKE on trivial pattern matches with VARCHAR data.
29 CS 2580 2589 2589 2599 2569 2569 2990 2539 2569 2639 2580 2540 2630 2589 2569 2549 2589 2579 2540 2589 3030 2589 2609 2580 2580 2529 2549 2589 2529 2609 2569
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
30 SS 2890 2880 2879 2869 2849 2950 3200 2929 2900 2900 4289 2880 2890 2889 2890 2809 2880 2890 2939 2900 2909 2890 2809 2870 2900 2899 2870 2889 3160 2889 2920
ALTER CURRENT USER fails with "no permission for <...> TABLE PLG$SRP" if current user: 1) has NO admin role and 2) wants to modify his own TAGS list
31 CS 3000 3009 2990 2980 3000 3039 4909 3060 2970 3009 2920 2980 2990 3060 3070 3060 3009 2990 2990 2960 3029 2980 3000 2980 2930 3070 2969 3109 3009 3410 2980
error read permission for BLOB field, when it is input/output procedure`s parametr
32 SS 3470 3430 3450 3590 3609 3600 3830 4069 3569 3550 3569 3419 3509 3450 3509 3400 3430 3669 3449 3430 3450 3480 3389 3449 3440 3460 3480 3439 3459 3480 3569
error read permission for BLOB field, when it is input/output procedure`s parametr
33 CS 2985 3000 2990 3029 3040 3000 4000 2970 2980 2980 2920 2960 2949 3009 3000 2980 2990 2990 3069 2960 4389 2990 3040 2920 2960 2980 2980 2960 3000 2919 2900
USING PLUGIN clause does not work in RECREATE USER
34 SS 3430 3449 3430 3430 3409 3480 4019 3450 3450 3509 3399 3460 3819 3570 3430 3350 3419 3430 3430 3410 3420 3440 3420 3420 3400 3410 3400 3419 3450 3579 3430
USING PLUGIN clause does not work in RECREATE USER
35 CS 4350 4350 4329 4319 4299 4319 4479 4430 4619 4519 4369 4420 4319 4429 4340 4319
SQL SECURITY DEFINER has inconsistent behaviour if the object owner is non-privileged
36 CS 1609 1619 1599 2009 1629 1619 1640 1600 1599 1630 1589 1569 1619 1629 1600 1619 1619 1620 1620 1619 1609 1609 1670 1590 1609 1600 1589 1609 1580 1589 1609
ISQL - SHOW DATABASE
37 SS 1834 1839 1789 1819 1789 1839 1849 1839 1829 1839 1850 1829 1840 1840 1789 1829 1829 1840 1839 1819 1819 1810 1820 1830 1840 1839 1839 1819 1840 1839 1799
ISQL - SHOW DATABASE
38 CS 2990 2960 2950 2930 2960 2879 3710 3120 3039 2990 2970 3089 2940 2900 2890 2990 3100 3049 2890 2970 3069 2930 3019 3010 2910 3089 2990 2940 3009 3009 3000
GTCS/tests/CF_ISQL_34. minimum-grant-test
39 SS 3370 3350 3449 3469 3480 3369 3259 3360 3369 3470 3370 3339 3380 3480 3429 3470 3360 3509 3370 3359 3370 3390 3470 3369 3359 3359 3349 3369 3389 3420 3440
GTCS/tests/CF_ISQL_34. minimum-grant-test
40 SS 31625 41970 41580 41700 42710 41700 42680 41769 41730 41580 41909 42710 21589 21670 21660 21619 21589 21620 21390 21359 21609 21579 21550 21610 21609 21529 21639 140700 140289 140269 159990
Replication gets stuck due to "Blob xxx.xx is not found for table xxx" error
41 CS 5915 5960 5990 5000 5960 5940 4819 5980 5539 5490 5959 5789 5889 5960 5740 5980 5960 5910 5779 5759 5700 5949 5759 5930 5930 5920 5960 5809 5960 5730 5740
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.
42 SS 6709 6000 6789 6709 6740 6539 4240 6710 6490 6730 6710 6680 6700 6769 6000 6789 6730 6690 6769 6730 6710 6649 6680 6759 6659 6660 6680 6710 6740 6710 6660
Verify sufficiency of privileges for performing DML actions. Verify that RETURNING clause can not be used without SELECT privilege.

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-2729
http://tracker.firebirdsql.org/browse/core-3242
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-3360
http://tracker.firebirdsql.org/browse/core-3365
http://tracker.firebirdsql.org/browse/core-3799
http://tracker.firebirdsql.org/browse/core-4054
http://tracker.firebirdsql.org/browse/core-4464
http://tracker.firebirdsql.org/browse/core-4766
http://tracker.firebirdsql.org/browse/core-5162
http://tracker.firebirdsql.org/browse/core-5664
http://tracker.firebirdsql.org/browse/core-5827
http://tracker.firebirdsql.org/browse/core-5982
http://tracker.firebirdsql.org/browse/core-6083
http://tracker.firebirdsql.org/browse/core-805
http://tracker.firebirdsql.org/browse/core-927
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/minimum-grant-test.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/replication/updating-blob-with-empty-string-stops-replication.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/dml-privileges-sufficiency.fbt
https://github.com/FirebirdSQL/firebird/issues/6935

=== end of list ===