0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (43 rows)
2. FRESH FAILS: tests which failed for LAST execution only (1 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (2 rows)
5. Has fails: tests with at least one fail for previous runs (122 rows)
[CURRENT] 6. Has runtime errors: tests with at least one runtime error for previous runs (26 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (2363 rows)
9. All tests: durations (4560 rows)
A. Skipped: tests which was intentionally excluded from execution (5 rows)

Generated 25.05.2022 10:52
Tested: FB50.   Build: 5.0.0.501;   SS: 25.05.22 06:02:36 - 25.05.22 08:28:20;   CS: 25.05.22 08:31:17 - 25.05.22 10:49:39;
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "ERROR" for last 30 runs:
NN Test name mode 5.0.0.501
2022-05-25
5.0.0.499
2022-05-24
5.0.0.498
2022-05-21
5.0.0.497
2022-05-20
5.0.0.496
2022-05-19
5.0.0.494
2022-05-14
5.0.0.493
2022-05-12
5.0.0.492
2022-05-07
5.0.0.491
2022-05-06
5.0.0.489
2022-05-01
5.0.0.488
2022-04-25
5.0.0.487
2022-04-24
5.0.0.482
2022-04-23
5.0.0.475
2022-04-16
5.0.0.472
2022-04-12
5.0.0.471
2022-04-10
5.0.0.469
2022-04-08
5.0.0.467
2022-04-07
5.0.0.459
2022-04-06
5.0.0.457
2022-04-04
5.0.0.455
2022-04-03
5.0.0.451
2022-04-02
5.0.0.448
2022-04-01
5.0.0.445
2022-03-31
5.0.0.442
2022-03-30
5.0.0.440
2022-03-28
5.0.0.439
2022-03-25
5.0.0.437
2022-03-24
5.0.0.426
2022-03-11
5.0.0.425
2022-03-08
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Non-privileged monitoring reports wrong attachment data
2 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Non-privileged monitoring reports wrong attachment data
3 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Suboptimal join plan if there are selective non-indexed predicates involved
4 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Suboptimal join plan if there are selective non-indexed predicates involved
5 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
6 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
7 CS P P P P P P P P P P P     E         E     P P P P P P P P P P P P P P P P P
Incorrect "string right truncation" error with NONE column and multibyte connection charset
8 SS P P P P P P P P P P P     E         E     P P P P P P P P P P P P P P P P P
Incorrect "string right truncation" error with NONE column and multibyte connection charset
9 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Better performance for (table.field = :param or :param = -1) in where clause
10 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Better performance for (table.field = :param or :param = -1) in where clause
11 CS P P P P P P P P P P P     E         E     P P P P P P P P P P P P P P P P P
CREATE COLLATION does not verify base collation charset
12 SS P P P P P P P P P P P     E         E     P P P P P P P P P P P P P P P P P
CREATE COLLATION does not verify base collation charset
13 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Poor performance of explicit cursors containing correlated subqueries in the select list
14 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Poor performance of explicit cursors containing correlated subqueries in the select list
15 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Conditions like WHERE <field> = <cursor>.<field> do not use existing index
16 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Conditions like WHERE <field> = <cursor>.<field> do not use existing index
17 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Regression: MIN/MAX with a join ignores possible index navigation
18 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Regression: MIN/MAX with a join ignores possible index navigation
19 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Regression: Non-indexed predicates may not be applied immediately after retrieval when tables are being joined
20 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Regression: Non-indexed predicates may not be applied immediately after retrieval when tables are being joined
21 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
FB >= 3 crashes when restoring backup made by FB 2.5.
22 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
FB >= 3 crashes when restoring backup made by FB 2.5.
23 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Check ability to get binary content of DB page by non-sysdba user who is granted with necessary system privilege.
24 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P     E     P P
Check ability to get binary content of DB page by non-sysdba user who is granted with necessary system privilege.
25 CS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Checking PK index is used when table is joined as driven (right) source in LEFT OUTER join from VIEW
26 SS P P P P P P P P P P P P P P P P P P P P     E     P P P P P P P P P
Checking PK index is used when table is joined as driven (right) source in LEFT OUTER join from VIEW

Elapsed time, milliseconds:
NN Test name mode median_ms 5.0.0.501
2022-05-25
5.0.0.499
2022-05-24
5.0.0.498
2022-05-21
5.0.0.497
2022-05-20
5.0.0.496
2022-05-19
5.0.0.494
2022-05-14
5.0.0.493
2022-05-12
5.0.0.492
2022-05-07
5.0.0.491
2022-05-06
5.0.0.489
2022-05-01
5.0.0.488
2022-04-25
5.0.0.487
2022-04-24
5.0.0.482
2022-04-23
5.0.0.475
2022-04-16
5.0.0.472
2022-04-12
5.0.0.471
2022-04-10
5.0.0.469
2022-04-08
5.0.0.467
2022-04-07
5.0.0.459
2022-04-06
5.0.0.457
2022-04-04
5.0.0.455
2022-04-03
5.0.0.451
2022-04-02
5.0.0.448
2022-04-01
5.0.0.445
2022-03-31
5.0.0.442
2022-03-30
5.0.0.440
2022-03-28
5.0.0.439
2022-03-25
5.0.0.437
2022-03-24
5.0.0.426
2022-03-11
5.0.0.425
2022-03-08
Test TITLE
1 CS 2730 2730 2000 2710 2730 2710 2720 2900 2770 2690 2830 2460 1320 1610 2420 3210 2730 2000 2530 2060 2780 2730 2730 2740 3090 2730 3810 2760 2780 2870 2670
Non-privileged monitoring reports wrong attachment data
2 SS 2860 2570 2510 2520 2940 2880 6550 3380 3330 2940 2900 2550 1890 1000 2960 2820 2560 2900 2950 1420 2560 2850 2870 2520 2840 2880 3600 2870 2960 2580 2580
Non-privileged monitoring reports wrong attachment data
3 CS 3135 3120 3100 3100 3080 3140 3640 3740 3730 3570 3830 2870 1590 2790 3300 3240 2800 2770 2810 1680 3140 2920 3090 3130 3180 3190 4820 3620 3590 3010 3530
Suboptimal join plan if there are selective non-indexed predicates involved
4 SS 3415 3380 3350 3420 3410 3350 6560 3870 3570 3480 3510 3400 2060 2290 3390 3410 3470 3370 3450 2120 3390 990 3000 3480 3510 3440 4100 3480 3390 3490 3540
Suboptimal join plan if there are selective non-indexed predicates involved
5 CS 2885 2830 2950 2920 2820 2970 2920 2960 3150 3120 3450 2560 1460 2360 2610 2700 2650 2690 2900 1980 3010 3260 2820 2850 3150 2870 4160 2920 2900 2730 2760
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
6 SS 2580 2540 2530 2540 2550 2550 5600 2610 2600 2590 3100 2560 1470 1560 2610 2590 2590 2570 2600 1460 2560 2560 2580 2580 2670 2640 3170 2540 2520 2630 2590
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
7 CS 2320 2320 2000 2240 2320 2230 2400 2390 2400 2400 2400 2110 2650 2320 2160 2170 2200 2120 2370 1280 2330 2320 2200 2320 2310 2330 3110 2580 2410 2230 2320
Incorrect "string right truncation" error with NONE column and multibyte connection charset
8 SS 2390 2380 2380 2380 2370 2380 2390 2770 2450 2420 2620 2370 1810 2560 2390 2390 2440 2410 2450 1740 2370 2370 2360 2370 2450 2390 3870 2360 2390 2430 2420
Incorrect "string right truncation" error with NONE column and multibyte connection charset
9 CS 3020 3020 3020 3000 3000 3010 4240 3120 3120 3120 4290 2860 1580 1720 2920 4430 2760 2760 4590 1870 2980 2260 2990 3130 3260 3120 4340 3150 2980 3280 3180
Better performance for (table.field = :param or :param = -1) in where clause
10 SS 3330 3280 3320 3320 3480 3470 4070 3510 3490 3540 4650 3370 1830 2100 3340 3000 3290 3320 3420 2910 3310 920 3310 3340 3420 3280 4540 3240 3270 3380 3400
Better performance for (table.field = :param or :param = -1) in where clause
11 CS 2210 2210 2220 2200 2210 2000 2210 2440 2210 2420 2220 2060 2710 1560 2410 2060 2070 2040 2180 1120 2170 2220 2210 2230 2340 2180 4670 2330 2450 2190 2200
CREATE COLLATION does not verify base collation charset
12 SS 2480 2420 2450 2450 2430 2470 2510 2840 2820 2870 2650 2490 1570 2390 2440 2480 2530 2490 2480 1350 2560 2470 2590 2540 2490 2600 4040 2450 2430 2440 2450
CREATE COLLATION does not verify base collation charset
13 CS 4225 4240 4270 4000 4260 4180 4150 4610 4420 4000 4220 5340 2870 4600 4070 3950 3930 3920 4710 2830 4260 2120 4190 4310 4290 4230 5780 4270 4210 4170 4350
Poor performance of explicit cursors containing correlated subqueries in the select list
14 SS 4460 4460 4520 4460 4000 4450 4000 5010 4700 4540 4560 4430 3130 3550 4460 4000 4510 4430 4540 3160 4470 920 4460 4480 4480 4430 8100 4430 4410 4430 4520
Poor performance of explicit cursors containing correlated subqueries in the select list
15 CS 2930 2930 2900 2950 2940 2910 3300 3350 3000 2930 3180 2730 1400 2060 2810 2920 2670 2700 2640 1640 3150 1360 2870 3020 2850 3010 5090 3020 3000 2960 2970
Conditions like WHERE <field> = <cursor>.<field> do not use existing index
16 SS 3180 3150 3000 3170 3190 3150 3260 3630 3670 3670 3310 3160 1760 1820 3230 3260 3000 3160 3000 1880 3170 970 3200 3180 3280 3280 4050 3170 3180 3240 3340
Conditions like WHERE <field> = <cursor>.<field> do not use existing index
17 CS 2855 2800 2890 2820 2870 3070 2840 2880 3020 2860 2970 2800 1440 1620 2740 2520 2620 3070 2560 1560 2880 2510 2830 2910 2860 2900 4640 2850 2880 2840 2870
Regression: MIN/MAX with a join ignores possible index navigation
18 SS 3160 3090 3210 3120 3140 3100 3180 3180 3180 3180 3270 3150 1770 1870 3180 3120 3240 3120 3850 1760 3170 950 3120 3140 3560 3200 4200 3150 3100 3180 3270
Regression: MIN/MAX with a join ignores possible index navigation
19 CS 2840 2840 2810 2870 2840 2850 2790 2880 2850 2880 3220 2830 1360 1670 2740 2590 2670 4190 2640 1630 2920 1000 2810 2820 2870 2980 4420 2920 2950 2790 2900
Regression: Non-indexed predicates may not be applied immediately after retrieval when tables are being joined
20 SS 3210 3230 3200 3200 3200 3210 3210 3210 3200 3210 3220 3260 1730 1920 3590 3220 3610 3260 3810 1800 3160 920 3600 3140 3310 3650 4100 3150 3180 3000 3460
Regression: Non-indexed predicates may not be applied immediately after retrieval when tables are being joined
21 CS 6870 6950 6900 6800 6960 6870 6950 7240 7660 7710 6870 6520 2980 3590 6660 6350 6100 6220 6130 3400 6680 4520 7060 6810 7100 6960 7640 7130 7240 6300 6970
FB >= 3 crashes when restoring backup made by FB 2.5.
22 SS 5625 5480 5520 5610 5590 5790 9000 5680 5710 5600 5690 5450 3490 4400 5580 5620 5620 6110 6520 3630 5710 4400 5790 5000 6310 5630 6630 5660 5540 5690 5730
FB >= 3 crashes when restoring backup made by FB 2.5.
23 CS 3445 3450 3000 3480 3470 3470 3510 3650 3600 3470 3480 3340 1000 1870 3310 3410 3160 3340 3150 1700 3430 6190 3630 3480 4580 3470 3890 3440 3000 3350 3370
Check ability to get binary content of DB page by non-sysdba user who is granted with necessary system privilege.
24 SS 3980 3930 3980 3960 4000 3970 3960 3930 4040 4020 4060 3950 2110 3290 3900 4410 4040 3990 3980 1990 3980 3960 4030 3900 3990 3980 3940 3980 3990 4020 4020
Check ability to get binary content of DB page by non-sysdba user who is granted with necessary system privilege.
25 CS 2975 3010 2920 3000 2990 2900 3460 3290 3920 2950 3310 2700 1400 1730 3000 2980 3800 3990 2800 1600 3030 1280 2980 2980 2900 2970 3950 2900 2950 2780 2950
Checking PK index is used when table is joined as driven (right) source in LEFT OUTER join from VIEW
26 SS 3260 3240 3310 3260 3210 3260 3340 3260 3230 3270 3320 3210 1980 2030 3310 3280 3330 4410 3680 1880 3260 900 3170 3200 3410 3330 3180 3280 3240 3280 3320
Checking PK index is used when table is joined as driven (right) source in LEFT OUTER join from VIEW

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1642
http://tracker.firebirdsql.org/browse/core-2078
http://tracker.firebirdsql.org/browse/core-2233
http://tracker.firebirdsql.org/browse/core-2651
http://tracker.firebirdsql.org/browse/core-3076
http://tracker.firebirdsql.org/browse/core-4180
http://tracker.firebirdsql.org/browse/core-4379
http://tracker.firebirdsql.org/browse/core-4675
http://tracker.firebirdsql.org/browse/core-4798
http://tracker.firebirdsql.org/browse/core-5018
http://tracker.firebirdsql.org/browse/core-5719
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/syspriv/read_raw_pages.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/eqc-343715.fbt

=== end of list ===