0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (12 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (0 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (40 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (4 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (1 rows)
8. All tests: outcomes (1964 rows)
9. All tests: durations (3872 rows)
A. Skipped: tests which was intentionally excluded from execution (36 rows)

Generated 05.02.2023 08:42
Tested: HQ30.   Build: 3.0.11.33657;   SS: 05.02.23 07:20:13 - 05.02.23 07:56:36;   CS: 05.02.23 07:58:01 - 05.02.23 08:41:24;
OS and hardware info:  Windows 10 10.0.19041 ; logical CPUs: 8 ; total memory: 31.7 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.11.33657
2023-02-05
3.0.11.33648
2023-01-18
3.0.11.33646
2022-12-07
3.0.11.33639
2022-11-25
3.0.11.33636
2022-10-29
3.0.11.33631
2022-10-20
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-07
3.0.11.33620
2022-09-05
3.0.11.33618
2022-08-23
3.0.11.33616
2022-08-17
3.0.11.33612
2022-07-31
3.0.10.33601
2022-07-17
3.0.10.33587
2022-06-04
3.0.10.33580
2022-04-30
3.0.10.33577
2022-04-25
3.0.10.33570
2022-04-17
3.0.10.33569
2022-02-25
3.0.9.33561
2022-02-22
3.0.9.33560
2022-02-13
3.0.9.33556
2022-02-09
3.0.9.33548
2022-01-12
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-10-31
3.0.8.33490
2021-09-22
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
Test TITLE
1 SS P P P P P P P P P P P P P P     F     P P P P P P P P P P P     F     P P P
Blob Comparison with constant
2 CS P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P
Server crash with isc_dsql_execute_immediate and zero length string
3 SS P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P
Server crash with isc_dsql_execute_immediate and zero length string
4 CS P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F     P P P
Success message when connecting to tiny trash database file
5 SS P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F     P P P
Success message when connecting to tiny trash database file
6 CS P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P
In SS sweep blocks establishment of concurrent attachments
8 CS P P P P P P P P P P P P P P P P P P P P P P P P     F     P     F         F         F     P
Increase speed of creating package when number of its functions more than several hundreds
9 SS P P P P P P P P P P P P P P P     F     P P P P P P P P P P P     F     P     F    
Increase speed of creating package when number of its functions more than several hundreds
10 SS P P P P P P P P P P P P P P P P P     F         F         F         F     P P P P P P P P P
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
11 CS P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P P
Detach using Linux client takes much longer than from Windows
12 CS P P P P P P P P P P P P P P     F     P P P P P P P P P     F     P P P P P
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
13 SS P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Wrong transaction can be passed to external engine
14 CS P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P
Better diagnostic when 'Missing security context'
15 SS P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P
Better diagnostic when 'Missing security context'
16 CS X X X X X X X X X X X X X X X X X X X X X X X X X X X     F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
17 SS X X X X X X X X X X X X X X X X X X X X X X X X X X X     F         F         F    
Many indexed reads in a compound index with NULLs [CORE2709]
18 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
19 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
20 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
21 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
22 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
23 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
24 SS P P P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P
Getting "records fetched" for functions/procedures in trace
25 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
DATEDIFF does not support fractional value for MILLISECOND
26 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
DATEDIFF does not support fractional value for MILLISECOND
27 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
28 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     X X X X
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
29 CS S S S S S S S S S S S S S S S S S S S S S S S     F         F         F         F         F         F         F    
INNER JOIN join order
30 SS S S S S S S S S S S S S S S S S S S S S S S S     F         F         F         F         F         F         F    
INNER JOIN join order
31 CS P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
32 SS P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with full match, but limited in ON clause
33 CS P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
34 SS P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F    
LEFT OUTER JOIN with STARTING WITH in WHERE clause
35 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F    
Check list of files in the current Firebird snapshot
36 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P     F         F         F    
Check list of files in the current Firebird snapshot
37 CS P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P
ISQL - SHOW DATABASE
38 SS P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P
ISQL - SHOW DATABASE
39 CS P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P
test de la fonction datediff pour avoir le resultat en minute
40 SS P P P P P P P P P P P P P P P P P P P P P P P P P     F     P P P P
test de la fonction datediff pour avoir le resultat en minute

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.11.33657
2023-02-05
3.0.11.33648
2023-01-18
3.0.11.33646
2022-12-07
3.0.11.33639
2022-11-25
3.0.11.33636
2022-10-29
3.0.11.33631
2022-10-20
3.0.11.33622
2022-09-10
3.0.11.33621
2022-09-07
3.0.11.33620
2022-09-05
3.0.11.33618
2022-08-23
3.0.11.33616
2022-08-17
3.0.11.33612
2022-07-31
3.0.10.33601
2022-07-17
3.0.10.33587
2022-06-04
3.0.10.33580
2022-04-30
3.0.10.33577
2022-04-25
3.0.10.33570
2022-04-17
3.0.10.33569
2022-02-25
3.0.9.33561
2022-02-22
3.0.9.33560
2022-02-13
3.0.9.33556
2022-02-09
3.0.9.33548
2022-01-12
3.0.8.33540
2021-12-20
3.0.8.33533
2021-12-01
3.0.8.33528
2021-11-08
3.0.8.33501
2021-10-31
3.0.8.33490
2021-09-22
3.0.8.33489
2021-08-10
3.0.8.33488
2021-08-07
3.0.8.33487
2021-07-31
Test TITLE
1 SS 1200 560 590 620 590 570 590 450 440 460 450 460 450 460 1720 2530 890 1680 1800 1710 1000 1760 1440 1460 1580 1420 1400 1450 1410 1440 1430
Blob Comparison with constant
2 CS 2045 670 660 710 710 770 760 650 660 650 670 720 670 640 2200 2260 830 2080 2200 2150 2070 2070 2090 2100 2110 2100 2090 2060 2060 2070 2030
Server crash with isc_dsql_execute_immediate and zero length string
3 SS 1345 470 480 480 470 480 490 400 410 440 410 420 420 400 1680 11650 760 1830 1710 1700 1960 1710 1430 1890 1420 1380 1380 1390 1350 1390 1340
Server crash with isc_dsql_execute_immediate and zero length string
4 CS 3330 1820 1760 1790 1790 2640 1860 1740 1740 1860 1870 1780 1930 1730 3710 3000 1900 3780 3760 3810 3980 3730 3720 3710 3730 3710 3710 4120 3720 3680 3660
Success message when connecting to tiny trash database file
5 SS 2565 1490 1520 1520 1490 1530 1000 1440 1460 1610 1600 1620 1470 1410 2920 3120 1770 3160 2910 2890 3060 2930 2620 2610 2620 2590 2590 2590 2570 2590 2560
Success message when connecting to tiny trash database file
6 CS 6715 5050 5030 5080 5160 5150 5130 4920 4910 4890 4890 5120 4930 4860 6820 7050 5030 6790 6880 6930 6960 6770 6810 6880 6920 6890 6720 6740 6720 6710 6760
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS 33315 21540 21640 21620 21580 23280 22480 21830 21320 21670 21600 21540 21740 20000 34490 36730 27870 34550 33410 33700 33540 33380 33290 33870 33700 33390 34530 33340 33820 33700 33670
In SS sweep blocks establishment of concurrent attachments
8 CS 37285 35000 35530 35900 35980 37290 37280 35450 36850 37010 39000 40700 41280 35690 94160 94000 64050 103460 97290 95440 94680 85690 83710 83090 83630 27950 27020 27330 27330 27310 27180
Increase speed of creating package when number of its functions more than several hundreds
9 SS 36440 36000 33950 39260 34310 34740 33920 36890 34280 36820 36060 45210 34000 35700 87460 89810 70890 86810 87360 87930 87740 88730 77080 75910 76660 26360 25850 25000 25880 25530 25520
Increase speed of creating package when number of its functions more than several hundreds
10 SS 3115 1270 1000 1410 1000 1320 1310 1010 1010 1020 1030 1270 1030 1030 4180 4090 2150 4140 4330 4240 4240 4090 3370 3310 3360 3280 3260 3230 3350 3260 3000
It is not possible to save the connection information in the ON CONNECT trigger, if the connection is created by the gbak
11 CS 3610 1740 1860 1770 1880 1840 1790 1680 1700 1730 1680 1720 1710 1640 3680 3820 1810 3760 3690 3870 3790 3700 4450 3620 4400 3850 3640 3620 3670 3600 3620
Detach using Linux client takes much longer than from Windows
12 CS 33980 18890 18090 18690 17320 18890 15190 13020 17780 13220 18210 13140 17610 18140 37330 50980 26210 47480 49140 42920 39000 42880 41780 48080 42030 51630 52320 33960 34000 36110 34420
At least 5 seconds delay on disconnect could happen if disconnect happens close after Event Manager initialization
13 SS 3130 990 1840 1860 1850 1850 1890 1810 1770 1720 1760 1730 1000 2200 3700 3710 2350 3680 4530 3000 3570 3840 3490 3340 3340 3360 3280 3260 3330 3390 3290
Wrong transaction can be passed to external engine
14 CS 4280 2190 2240 2310 2210 2260 2390 1980 2050 2140 2100 2050 2140 2110 4480 4560 2320 4390 4480 4770 4490 4400 4340 4290 4370 5850 4310 4310 4360 5210 4270
Better diagnostic when 'Missing security context'
15 SS 2750 1790 1810 1790 1780 2100 1810 1550 1590 1560 1540 1620 1580 1530 3070 3160 1970 3230 3110 3260 3090 3220 2830 2810 2860 4700 2800 2790 2740 2770 2760
Better diagnostic when 'Missing security context'
16 CS 7360 7810 7340 7360
Many indexed reads in a compound index with NULLs [CORE2709]
17 SS 5650 5710 5650 5620
Many indexed reads in a compound index with NULLs [CORE2709]
18 CS 725 570 580 630 620 680 670 570 570 560 570 610 590 580 1690 1780 770 2440 1700 1770 1700 1660 1670 1660 1700 1670 1630
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
19 SS 575 430 450 450 440 460 470 390 380 380 380 380 390 380 1450 1400 680 1420 1480 1480 1450 1480 1200 1160 1200 1120 1140
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode [CORE3529]
20 CS 665 600 610 590 630 660 660 570 560 570 580 600 590 540 1730 1680 670 1870 1690 1820 1930 1650 1670 1600 1660 1650 1650
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
21 SS 610 430 440 440 430 450 440 370 370 370 370 380 370 360 1440 1380 770 1410 1550 1000 1410 1450 1170 1140 1170 1110 1110
Exception "too few key columns found for index" raises when attempt to create table with PK and immediatelly drop this PK within the same transaction [CORE4783]
22 CS 690 560 600 650 640 670 670 570 570 580 580 590 590 580 1690 1720 710 2060 1000 1780 1730 1660 1680 1670 1670 1670 1690
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
23 SS 570 460 450 470 440 460 460 370 370 370 380 380 400 380 1440 1380 670 1430 1480 1540 1510 1480 1200 1180 1200 1150 1120
Compound ALTER TABLE statement with ADD and DROP the same constraint failed if this constraint involves index creation (PK/UNQ/FK) [CORE4878]
24 SS 5215 4050 4020 4090 4030 4110 4060 3810 4240 3850 3800 3950 3860 3000 5740 5000 4570 5730 5870 5910 5780 5770 5930 5590 5530 5470 5450 5440 5490 5460 5430
Getting "records fetched" for functions/procedures in trace
25 CS 640 570 600 610 600 640 640 590 550 560 580 620 570 550 1640 1620 0 1640 1670 1700 1680 1660 1640 1670 1660 1650 1600
DATEDIFF does not support fractional value for MILLISECOND
26 SS 550 460 440 440 420 450 420 360 360 360 410 360 360 360 1400 1530 640 1370 1610 1460 1420 1380 1080 1370 1150 1090 1100
DATEDIFF does not support fractional value for MILLISECOND
27 CS 2225 1000 1000 1790 1790 1920 1830 1790 1670 1790 1680 1830 1720 1630 4600 4700 2530 4790 4830 4790 4710 5030 4800 4660 4000 4840 5130
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
28 SS 1990 1410 1510 1400 1380 1490 1410 1260 1000 1000 1400 1280 1280 1240 3770 4310 2470 3890 4660 3870 3820 3850 3540 3600 3590 3490 4700
gbak -b failed with "invalid transaction handle (expecting explicit transaction start)"
29 CS 2630 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 2670 2830 2590 2630 2580 2630 2000
INNER JOIN join order
30 SS 1900 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1930 1920 1840 2000 1900 1890 1870
INNER JOIN join order
31 CS 2000 770 850 860 830 890 900 770 710 730 720 0 730 700 2350 2390 1030 2260 2480 2270 2390 2000 2230 2000 2200 2210 2170 2240 2190 2160 2170
LEFT OUTER JOIN with full match, but limited in ON clause
32 SS 1450 600 580 610 590 600 610 480 470 470 520 490 490 470 1780 1720 810 2030 1860 1880 1850 1810 1510 1480 1540 1480 1520 1450 1460 1450 1460
LEFT OUTER JOIN with full match, but limited in ON clause
33 CS 2000 780 840 850 830 880 940 730 710 720 730 760 0 710 2340 2290 960 2260 2700 2420 2320 2260 2230 2220 2200 2000 2170 2000 2000 2150 2160
LEFT OUTER JOIN with STARTING WITH in WHERE clause
34 SS 1430 620 600 610 610 610 620 490 470 480 520 490 0 480 1790 1770 820 1730 1870 1860 1780 1830 1520 1000 1550 1510 1470 1430 1470 1460 1440
LEFT OUTER JOIN with STARTING WITH in WHERE clause
35 CS 1340 550 570 630 660 700 650 610 620 630 620 630 640 600 1840 1830 830 2150 1810 1780 1790 2270 1730 1740 1730 1740 1690 1680 1000 1730 1700
Check list of files in the current Firebird snapshot
36 SS 1100 370 370 400 360 380 380 390 370 360 370 400 380 360 1420 1810 770 1820 1630 1480 1440 1820 1160 1140 1170 1140 1120 1110 1120 1090 1120
Check list of files in the current Firebird snapshot
37 CS 1570 580 560 630 620 660 660 560 600 560 550 560 580 550 1640 1780 640 1770 1700 1950 1670 1660 1630 1650 1640 1640 1590 1620 1580 1560 1590
ISQL - SHOW DATABASE
38 SS 1080 430 430 440 420 420 470 360 370 360 360 370 370 360 1420 1380 720 2050 1460 1440 1390 1440 1120 1130 1150 1110 1110 1090 1110 1090 1070
ISQL - SHOW DATABASE
39 CS 1580 570 580 600 610 640 650 590 550 580 560 580 580 550 1690 1680 1230 1640 1710 1670 1680 1640 1740 1610 1640 1640 1590 1590 1610 1620 1570
test de la fonction datediff pour avoir le resultat en minute
40 SS 1080 430 420 430 410 440 440 360 360 370 370 510 380 360 1390 1360 640 1380 1450 1430 1430 1440 1130 1110 1150 1260 1100 1110 1090 1070 1090
test de la fonction datediff pour avoir le resultat en minute

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1506
http://tracker.firebirdsql.org/browse/core-2484
http://tracker.firebirdsql.org/browse/core-284
http://tracker.firebirdsql.org/browse/core-3658
http://tracker.firebirdsql.org/browse/core-4135
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-4928
http://tracker.firebirdsql.org/browse/core-4977
http://tracker.firebirdsql.org/browse/core-5034
http://tracker.firebirdsql.org/browse/core-5645
http://tracker.firebirdsql.org/browse/core-6362
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_06.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_left_join_11.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/build/snapshot-files-check-list.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/basic/isql/isql_01.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/intfunc/date/datediff_07.fbt
https://github.com/FirebirdSQL/firebird/issues/3106
https://github.com/FirebirdSQL/firebird/issues/3886
https://github.com/FirebirdSQL/firebird/issues/5082
https://github.com/FirebirdSQL/firebird/issues/5173
https://github.com/FirebirdSQL/firebird/issues/6782
https://github.com/FirebirdSQL/firebird/issues/6987
https://github.com/FirebirdSQL/firebird/issues/7031

=== end of list ===