0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (14 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (1 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (44 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (4 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (1966 rows)
9. All tests: durations (3874 rows)
A. Skipped: tests which was intentionally excluded from execution (5 rows)

Generated 01.10.2022 13:40
Tested: HQ30.   Build: 3.0.11.33631;   CS: 01.10.22 12:54:46 - 01.10.22 13:38:53;   SS: 01.10.22 12:16:24 - 01.10.22 12:53:16;
OS and hardware info:  Windows 10 10.0.19041 ; logical CPUs: 8 ; total memory: 31.7 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.11.33631
2022-10-01
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-07
3.0.11.33620
2022-09-05
3.0.11.33618
2022-08-23
3.0.11.33616
2022-08-17
3.0.11.33612
2022-07-31
3.0.10.33601
2022-07-17
3.0.10.33587
2022-06-04
3.0.10.33580
2022-04-30
3.0.10.33577
2022-04-25
3.0.10.33570
2022-04-17
3.0.10.33569
2022-02-25
3.0.9.33561
2022-02-22
3.0.9.33560
2022-02-13
3.0.9.33556
2022-02-09
3.0.9.33548
2022-01-12
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-10-31
3.0.8.33490
2021-09-22
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33475
2021-07-20
3.0.8.33472
2021-06-18
3.0.8.33471
2021-06-09
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
Test TITLE
1 SS P P P P P P P P P     F     P P P P P P P P P P P     F     P P P P P P P P
Blob Comparison with constant
2 CS P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P
Server crash with isc_dsql_execute_immediate and zero length string
3 SS P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P
Server crash with isc_dsql_execute_immediate and zero length string
4 CS P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P
Success message when connecting to tiny trash database file
5 SS P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F     P P P P P P P P
Success message when connecting to tiny trash database file
6 CS P P P P P P P     F     P P P P P P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P
In SS sweep blocks establishment of concurrent attachments
8 CS P P P P P P P P P P P P P P P P P P P     F     P     F         F         F     P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
9 SS P P P P P P P P P P     F     P P P P P P P P P P P     F     P     F     P P P P P
Increase speed of creating package when number of its functions more than several hundreds
10 SS P P P P P P P P P P P P     F         F         F         F     P P P P P P P P P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
11 CS P P P P P P P P P P P P P P P P     F     P P P P P P P P P P P P P
Detach using Linux client takes much longer than from Windows
12 CS P P P P P P P P P     F     P P P P P P P P P     F     P P P P P P     F         F     P     F    
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
13 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Wrong transaction can be passed to external engine
14 CS P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P
Better diagnostic when 'Missing security context'
15 SS P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P P
Better diagnostic when 'Missing security context'
16 CS X X X X X X X X X X X X X X X X X X X X X X     F         F         F         F         F         F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
17 SS X X X X X X X X X X X X X X X X X X X X X X     F         F         F         F         F         F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
18 CS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
19 SS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
20 CS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
21 SS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
22 CS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
23 SS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
24 SS P P P P P P P     F     P P P P P P P P P P P P P P P P P P     F         F     P P
Getting "records fetched" for functions/procedures in trace
25 CS S S S S S S S S S S S S S S S S S S S S S S S S S S     F     X X X
Crash occurs when use SIMILAR TO ...
26 SS S S S S S S S S S S S S S S S S S S S S S S S S S S     F     X X X
Crash occurs when use SIMILAR TO ...
27 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Some orphan records left at RDB$SECURITY_CLASSES and RDB$USER_PRIVILEGES after DROP PROCEDURE\FUNCTION
28 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Some orphan records left at RDB$SECURITY_CLASSES and RDB$USER_PRIVILEGES after DROP PROCEDURE\FUNCTION
29 CS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
30 SS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
DATEDIFF does not support fractional value for MILLISECOND
31 CS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
32 SS P P P P P P P P P P P P P P P P P P P P     F     X X X X X X X X X
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
33 CS S S S S S S S S S S S S S S S S S S     F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
34 SS S S S S S S S S S S S S S S S S S S     F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
35 CS P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
36 SS P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
37 CS P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
38 SS P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
39 CS P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F     P
Check list of files in the current Firebird snapshot
40 SS P P P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F     P
Check list of files in the current Firebird snapshot
41 CS P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P
ISQL - SHOW DATABASE
42 SS P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P
ISQL - SHOW DATABASE
43 CS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute
44 SS P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P P
test de la fonction datediff pour avoir le resultat en minute

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.11.33631
2022-10-01
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-07
3.0.11.33620
2022-09-05
3.0.11.33618
2022-08-23
3.0.11.33616
2022-08-17
3.0.11.33612
2022-07-31
3.0.10.33601
2022-07-17
3.0.10.33587
2022-06-04
3.0.10.33580
2022-04-30
3.0.10.33577
2022-04-25
3.0.10.33570
2022-04-17
3.0.10.33569
2022-02-25
3.0.9.33561
2022-02-22
3.0.9.33560
2022-02-13
3.0.9.33556
2022-02-09
3.0.9.33548
2022-01-12
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-10-31
3.0.8.33490
2021-09-22
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
3.0.8.33475
2021-07-20
3.0.8.33472
2021-06-18
3.0.8.33471
2021-06-09
3.0.8.33470
2021-06-02
3.0.8.33468
2021-05-29
Test TITLE
1 SS 1430 560 450 440 460 450 460 450 460 1720 2530 890 1680 1800 1710 1000 1760 1440 1460 1580 1420 1400 1450 1410 1440 1430 1440 1440 1000 1450 1430
Blob Comparison with constant
2 CS 2070 730 650 660 650 670 720 670 640 2200 2260 830 2080 2200 2150 2070 2070 2090 2100 2110 2100 2090 2060 2060 2070 2030 2060 2080 2150 2090 2040
Server crash with isc_dsql_execute_immediate and zero length string
3 SS 1390 470 400 410 440 410 420 420 400 1680 11650 760 1830 1710 1700 1960 1710 1430 1890 1420 1380 1380 1390 1350 1390 1340 1380 1480 1390 1390 1390
Server crash with isc_dsql_execute_immediate and zero length string
4 CS 3670 1820 1740 1740 1860 1870 1780 1930 1730 3710 3000 1900 3780 3760 3810 3980 3730 3720 3710 3730 3710 3710 4120 3720 3680 3660 3690 3510 3620 3530 3410
Success message when connecting to tiny trash database file
5 SS 2580 1490 1440 1460 1610 1600 1620 1470 1410 2920 3120 1770 3160 2910 2890 3060 2930 2620 2610 2620 2590 2590 2590 2570 2590 2560 2630 2530 2530 2510 2400
Success message when connecting to tiny trash database file
6 CS 6765 5270 4920 4910 4890 4890 5120 4930 4860 6820 7050 5030 6790 6880 6930 6960 6770 6810 6880 6920 6890 6720 6740 6720 6710 6760 7190 6790 6820 6860 6740
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS 33400 21810 21830 21320 21670 21600 21540 21740 20000 34490 36730 27870 34550 33410 33700 33540 33380 33290 33870 33700 33390 34530 33340 33820 33700 33670 33540 34090 34720 33280 32400
In SS sweep blocks establishment of concurrent attachments
8 CS 36930 36100 35450 36850 37010 39000 40700 41280 35690 94160 94000 64050 103460 97290 95440 94680 85690 83710 83090 83630 27950 27020 27330 27330 27310 27180 23470 23700 23850 23680 23450
Increase speed of creating package when number of its functions more than several hundreds
9 SS 36440 37470 36890 34280 36820 36060 45210 34000 35700 87460 89810 70890 86810 87360 87930 87740 88730 77080 75910 76660 26360 25850 25000 25880 25530 25520 21550 21890 22150 22070 21960
Increase speed of creating package when number of its functions more than several hundreds
10 SS 3285 1260 1010 1010 1020 1030 1270 1030 1030 4180 4090 2150 4140 4330 4240 4240 4090 3370 3310 3360 3280 3260 3230 3350 3260 3000 3240 3300 3320 3290 3290
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
11 CS 3620 1000 1680 1700 1730 1680 1720 1710 1640 3680 3820 1810 3760 3690 3870 3790 3700 4450 3620 4400 3850 3640 3620 3670 3600 3620 3610 3650 3680 3620 3590
Detach using Linux client takes much longer than from Windows
12 CS 38165 19050 13020 17780 13220 18210 13140 17610 18140 37330 50980 26210 47480 49140 42920 39000 42880 41780 48080 42030 51630 52320 33960 34000 36110 34420 33840 57860 58410 47560 40240
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
13 SS 3305 2000 1810 1770 1720 1760 1730 1000 2200 3700 3710 2350 3680 4530 3000 3570 3840 3490 3340 3340 3360 3280 3260 3330 3390 3290 3350 3290 3350 3320 3260
Wrong transaction can be passed to external engine
14 CS 4320 2230 1980 2050 2140 2100 2050 2140 2110 4480 4560 2320 4390 4480 4770 4490 4400 4340 4290 4370 5850 4310 4310 4360 5210 4270 4320 4360 4810 4320 4020
Better diagnostic when 'Missing security context'
15 SS 2790 1840 1550 1590 1560 1540 1620 1580 1530 3070 3160 1970 3230 3110 3260 3090 3220 2830 2810 2860 4700 2800 2790 2740 2770 2760 3780 2800 2760 2790 2640
Better diagnostic when 'Missing security context'
16 CS 7460 7810 7340 7360 7440 7550 7480 8000 7350
Many indexed reads in a compound index with NULLs [CORE2709]
17 SS 5680 5710 5650 5620 5630 5710 5820 5740 5410
Many indexed reads in a compound index with NULLs [CORE2709]
18 CS 1660 640 570 570 560 570 610 590 580 1690 1780 770 2440 1700 1770 1700 1660 1670 1660 1700 1670 1630
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
19 SS 1140 440 390 380 380 380 380 390 380 1450 1400 680 1420 1480 1480 1450 1480 1200 1160 1200 1120 1140
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
20 CS 1650 620 570 560 570 580 600 590 540 1730 1680 670 1870 1690 1820 1930 1650 1670 1600 1660 1650 1650
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
21 SS 1110 460 370 370 370 370 380 370 360 1440 1380 770 1410 1550 1000 1410 1450 1170 1140 1170 1110 1110
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
22 CS 1660 650 570 570 580 580 590 590 580 1690 1720 710 2060 1000 1780 1730 1660 1680 1670 1670 1670 1690
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
23 SS 1150 470 370 370 370 380 380 400 380 1440 1380 670 1430 1480 1540 1510 1480 1200 1180 1200 1150 1120
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
24 SS 5465 4030 3810 4240 3850 3800 3950 3860 3000 5740 5000 4570 5730 5870 5910 5780 5770 5930 5590 5530 5470 5450 5440 5490 5460 5430 5460 8310 8330 8410 8130
Getting "records fetched" for functions/procedures in trace
25 CS 3940 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3940
Crash occurs when use SIMILAR TO ...
26 SS 5850 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 5850
Crash occurs when use SIMILAR TO ...
27 CS 1875 770 710 770 710 720 780 730 690 1980 1990 960 1970 1990 1980 1960 2200 1930 1890 1890 1920 1880 1870 1960 1860 1870 1840
Some orphan records left at RDB$SECURITY_CLASSES and RDB$USER_PRIVILEGES after DROP PROCEDURE\FUNCTION
28 SS 1330 570 0 0 510 510 590 0 0 1590 1630 870 1610 1000 1680 1680 1650 1400 1340 1410 1310 1330 1310 1330 1340 1330 1290
Some orphan records left at RDB$SECURITY_CLASSES and RDB$USER_PRIVILEGES after DROP PROCEDURE\FUNCTION
29 CS 1630 610 590 550 560 580 620 570 550 1640 1620 0 1640 1670 1700 1680 1660 1640 1670 1660 1650 1600
DATEDIFF does not support fractional value for MILLISECOND
30 SS 1090 420 360 360 360 410 360 360 360 1400 1530 640 1370 1610 1460 1420 1380 1080 1370 1150 1090 1100
DATEDIFF does not support fractional value for MILLISECOND
31 CS 4600 1810 1790 1670 1790 1680 1830 1720 1630 4600 4700 2530 4790 4830 4790 4710 5030 4800 4660 4000 4840 5130
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
32 SS 3540 1390 1260 1000 1000 1400 1280 1280 1240 3770 4310 2470 3890 4660 3870 3820 3850 3540 3600 3590 3490 4700
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
33 CS 2610 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2670 2830 2590 2630 2580 2630 2000 2550 2590 2550 2660 2630
INNER JOIN join order
34 SS 1895 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1930 1920 1840 2000 1900 1890 1870 1810 1800 1910 1870 1940
INNER JOIN join order
35 CS 2170 840 770 710 730 720 0 730 700 2350 2390 1030 2260 2480 2270 2390 2000 2230 2000 2200 2210 2170 2240 2190 2160 2170 2170 2270 2000 2220 2140
LEFT OUTER JOIN with full match, but limited in ON clause
36 SS 1455 600 480 470 470 520 490 490 470 1780 1720 810 2030 1860 1880 1850 1810 1510 1480 1540 1480 1520 1450 1460 1450 1460 1450 1000 1000 1000 1470
LEFT OUTER JOIN with full match, but limited in ON clause
37 CS 2160 830 730 710 720 730 760 0 710 2340 2290 960 2260 2700 2420 2320 2260 2230 2220 2200 2000 2170 2000 2000 2150 2160 2170 2000 2260 2200 2150
LEFT OUTER JOIN with STARTING WITH in WHERE clause
38 SS 1460 590 490 470 480 520 490 0 480 1790 1770 820 1730 1870 1860 1780 1830 1520 1000 1550 1510 1470 1430 1470 1460 1440 1450 1480 1000 1000 1530
LEFT OUTER JOIN with STARTING WITH in WHERE clause
39 CS 1695 620 610 620 630 620 630 640 600 1840 1830 830 2150 1810 1780 1790 2270 1730 1740 1730 1740 1690 1680 1000 1730 1700 1690 1000 1000 1700 1720
Check list of files in the current Firebird snapshot
40 SS 1135 370 390 370 360 370 400 380 360 1420 1810 770 1820 1630 1480 1440 1820 1160 1140 1170 1140 1120 1110 1120 1090 1120 1130 1140 1170 1160 1160
Check list of files in the current Firebird snapshot
41 CS 1600 610 560 600 560 550 560 580 550 1640 1780 640 1770 1700 1950 1670 1660 1630 1650 1640 1640 1590 1620 1580 1560 1590 1560 1630 1650 1610 1590
ISQL - SHOW DATABASE
42 SS 1110 430 360 370 360 360 370 370 360 1420 1380 720 2050 1460 1440 1390 1440 1120 1130 1150 1110 1110 1090 1110 1090 1070 1070 1110 1130 1140 1120
ISQL - SHOW DATABASE
43 CS 1610 670 590 550 580 560 580 580 550 1690 1680 1230 1640 1710 1670 1680 1640 1740 1610 1640 1640 1590 1590 1610 1620 1570 1610 1640 1640 1640 1590
test de la fonction datediff pour avoir le resultat en minute
44 SS 1095 430 360 360 370 370 510 380 360 1390 1360 640 1380 1450 1430 1430 1440 1130 1110 1150 1260 1100 1110 1090 1070 1090 1080 1090 1110 1110 1090
test de la fonction datediff pour avoir le resultat en minute

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1506
http://tracker.firebirdsql.org/browse/core-2484
http://tracker.firebirdsql.org/browse/core-284
http://tracker.firebirdsql.org/browse/core-3658
http://tracker.firebirdsql.org/browse/core-4135
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-4928
http://tracker.firebirdsql.org/browse/core-4977
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5645
http://tracker.firebirdsql.org/browse/core-6362
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/build/snapshot-files-check-list.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/firebird/issues/3106
https://github.com/FirebirdSQL/firebird/issues/3886
https://github.com/FirebirdSQL/firebird/issues/5082
https://github.com/FirebirdSQL/firebird/issues/5173
https://github.com/FirebirdSQL/firebird/issues/6782
https://github.com/FirebirdSQL/firebird/issues/6854
https://github.com/FirebirdSQL/firebird/issues/6866
https://github.com/FirebirdSQL/firebird/issues/6987
https://github.com/FirebirdSQL/firebird/issues/7031

=== end of list ===