0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (11 rows)
2. FRESH FAILS: tests which failed for LAST execution only (1 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
[CURRENT] 4. STILL FAILS: tests which fail for at least two last runs (15 rows)
5. Has fails: tests with at least one fail for previous runs (44 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (1 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (2 rows)
8. All tests: outcomes (4539 rows)
9. All tests: durations (4546 rows)
A. Skipped: tests which was intentionally excluded from execution (8 rows)

Generated 01.07.2022 10:49
Tested: FB40.   Build: 4.0.2.2796;   SS: 01.07.22 08:43:02 - 01.07.22 09:44:23;   CS: 01.07.22 09:46:24 - 01.07.22 10:47:49;
OS and hardware info:  Windows 10 10.0.19041 ; logical CPUs: 8 ; total memory: 31.7 Gb 

Tests which fail for at least two last runs:
NN Test name mode 4.0.2.2796
2022-07-01
4.0.2.2794
2022-06-30
4.0.2.2793
2022-06-29
4.0.2.2792
2022-06-28
4.0.2.2789
2022-06-26
4.0.2.2787
2022-06-24
4.0.2.2780
2022-06-17
4.0.2.2779
2022-06-15
4.0.2.2776
2022-06-10
4.0.2.2775
2022-06-09
4.0.2.2774
2022-06-08
4.0.2.2772
2022-06-03
4.0.2.2771
2022-06-01
4.0.2.2770
2022-05-25
4.0.2.2768
2022-05-24
4.0.2.2767
2022-05-20
4.0.2.2766
2022-05-19
4.0.2.2764
2022-05-12
4.0.2.2763
2022-05-06
4.0.2.2762
2022-05-01
4.0.2.2761
2022-04-24
4.0.2.2758
2022-04-12
4.0.2.2757
2022-04-10
4.0.2.2750
2022-04-07
4.0.2.2746
2022-04-04
4.0.2.2745
2022-03-27
4.0.2.2744
2022-03-24
4.0.2.2739
2022-03-11
4.0.2.2738
2022-03-09
4.0.2.2737
2022-03-08
Test TITLE
1 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
Floating-point negative zero doesn't match positive zero in the index
2 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Floating-point negative zero doesn't match positive zero in the index
3 SS     F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P P
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
4 CS     F         F         F     P P P P P P P P P P P P P P P P P P P P P P X P P P P
Increase speed of creating package when number of its functions more than several hundreds
5 SS     F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P P P P
Increase speed of creating package when number of its functions more than several hundreds
6 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
7 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
8 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
Connection does not see itself in the MON$ATTACHMENTS when Domain/Username (using SSPI) is 31 bytes long
9 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Connection does not see itself in the MON$ATTACHMENTS when Domain/Username (using SSPI) is 31 bytes long
10 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
Ability to query Firebird configuration using SQL
11 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
Ability to query Firebird configuration using SQL
12 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
GTCS/tests/DSQL_DOMAIN_22. Verify result of ALTER DOMAIN with changing NOT NULL flag and CHECK constraints when a table exists with field based on this domain.
13 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
GTCS/tests/DSQL_DOMAIN_22. Verify result of ALTER DOMAIN with changing NOT NULL flag and CHECK constraints when a table exists with field based on this domain.
14 CS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P X P P P P
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
15 SS     F         F         F         F         F         F     P P P P P P P P P P P P P P P P P P P P P P P P
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.2.2796
2022-07-01
4.0.2.2794
2022-06-30
4.0.2.2793
2022-06-29
4.0.2.2792
2022-06-28
4.0.2.2789
2022-06-26
4.0.2.2787
2022-06-24
4.0.2.2780
2022-06-17
4.0.2.2779
2022-06-15
4.0.2.2776
2022-06-10
4.0.2.2775
2022-06-09
4.0.2.2774
2022-06-08
4.0.2.2772
2022-06-03
4.0.2.2771
2022-06-01
4.0.2.2770
2022-05-25
4.0.2.2768
2022-05-24
4.0.2.2767
2022-05-20
4.0.2.2766
2022-05-19
4.0.2.2764
2022-05-12
4.0.2.2763
2022-05-06
4.0.2.2762
2022-05-01
4.0.2.2761
2022-04-24
4.0.2.2758
2022-04-12
4.0.2.2757
2022-04-10
4.0.2.2750
2022-04-07
4.0.2.2746
2022-04-04
4.0.2.2745
2022-03-27
4.0.2.2744
2022-03-24
4.0.2.2739
2022-03-11
4.0.2.2738
2022-03-09
4.0.2.2737
2022-03-08
Test TITLE
1 CS 2150 670 660 650 670 780 680 2230 2010 1980 2000 1980 2210 2160 2150 2170 2200 2180 2190 2210 2840 860 1980 1980 2070 2170 2230 2170 2310 2170
Floating-point negative zero doesn't match positive zero in the index
2 SS 2420 640 640 640 640 720 630 2450 2400 2480 2410 2440 2460 2400 2440 2370 2420 2410 2820 2450 2460 1220 2760 2940 2000 2440 2440 2420 2430 2410 2800
Floating-point negative zero doesn't match positive zero in the index
3 SS 28210 8440 8470 8830 8640 9290 8340 29280 29490 27120 27460 28000 30010 27490 29620 28650 26740 28420 27000 28000 30940 15840 29030 28850 29550 29510 30050 29960 27220 30520 29190
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
4 CS 108850 38620 41370 38640 37190 42270 40740 110270 106380 106860 106470 106130 110790 110840 109800 108850 110000 109840 111220 111270 121230 74620 106220 106430 112600 109070 109650 108120 111110 109280
Increase speed of creating package when number of its functions more than several hundreds
5 SS 111150 40180 44350 44520 39810 39320 46090 112480 110930 112210 111540 111320 110980 111100 110820 111120 111180 110770 111240 118890 125330 86140 112070 111940 126490 110980 110420 112730 112850 114730 111380
Increase speed of creating package when number of its functions more than several hundreds
6 CS 8810 6200 6640 6210 6160 6760 6460 8680 8640 8640 8000 8640 8890 8940 8970 8890 8970 9010 8810 9190 8890 6590 8600 9120 12930 8920 8950 8830 8810 8860
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
7 SS 8510 5880 5860 5930 5870 6490 5920 8510 8540 8000 8580 8000 8520 8490 9050 8520 8510 8470 8550 8560 8560 6670 8920 8440 8530 8610 8520 8510 8550 8510 8440
Timeout for IDLE connection (SET SESSION IDLE TIMEOUT <N>)
8 CS 4630 2480 2010 2020 2030 2130 2050 4830 4710 4430 4450 4470 4690 4770 5140 4660 4600 4800 4850 4710 4850 2290 4320 4850 6810 4630 4990 4570 4620 4630
Connection does not see itself in the MON$ATTACHMENTS when Domain/Username (using SSPI) is 31 bytes long
9 SS 4545 1830 1850 1810 1820 1920 1860 4580 4520 4520 4580 4600 4590 4700 4550 4530 4510 4000 4560 4570 5090 2840 4570 4570 4680 4550 4540 4650 4000 4590 4540
Connection does not see itself in the MON$ATTACHMENTS when Domain/Username (using SSPI) is 31 bytes long
10 CS 7940 10530 10390 10110 10030 10560 10070 7640 7000 7760 7820 7850 8240 7880 8080 7880 8070 8230 7940 7840 7850 5530 7850 7860 8150 7780 9080 7940 8540 8040
Ability to query Firebird configuration using SQL
11 SS 7705 9930 9920 9890 9920 10590 9930 7470 7660 7590 7510 7490 7700 7470 7650 7730 7800 7610 8990 7600 7690 5650 7620 8160 7770 146590 7000 7830 7800 7570 7710
Ability to query Firebird configuration using SQL
12 CS 3710 1190 1180 1210 1200 1120 1240 3590 3510 3510 3520 3480 3780 3700 3810 3720 3790 3730 3860 3730 3880 1870 3620 4360 6590 3730 3790 3760 3710 3740
GTCS/tests/DSQL_DOMAIN_22. Verify result of ALTER DOMAIN with changing NOT NULL flag and CHECK constraints when a table exists with field based on this domain.
13 SS 3760 1150 1150 1160 1170 1090 1150 3840 3760 3820 3780 3710 3930 3850 3710 3710 3670 3740 3830 3830 4540 2220 3810 3820 3890 3770 3810 4290 3760 3730 3760
GTCS/tests/DSQL_DOMAIN_22. Verify result of ALTER DOMAIN with changing NOT NULL flag and CHECK constraints when a table exists with field based on this domain.
14 CS 3270 1000 2240 1770 1830 1890 1810 3120 3140 3140 3130 3150 3380 3400 3340 3280 3270 3310 3350 3270 3370 2050 3260 3610 3290 3330 3310 3360 3300 3590
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype
15 SS 3430 2170 1650 1650 1670 1830 1660 3420 3430 3470 3400 3430 3450 3430 3450 3410 3430 3420 3460 3400 4080 2240 3590 3460 3540 3460 3470 3000 3430 3400 3430
GTCS/tests/external-file-06-d. Test for external table with field of DOUBLE PRECISION datatype

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-3547
http://tracker.firebirdsql.org/browse/core-4337
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5488
http://tracker.firebirdsql.org/browse/core-6097
http://tracker.firebirdsql.org/browse/core-6444
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/dsql-domain-22.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/gtcs/external-file-06-d.fbt

=== end of list ===