0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (1 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (2 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (12 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (60 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (0 rows)
8. All tests: outcomes (1939 rows)
9. All tests: durations (3796 rows)
A. Skipped: tests which was intentionally excluded from execution (3 rows)

Generated 03.12.2020 11:09 on host "IBSURGEON-2008":

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.8.33396
2020-12-03
3.0.8.33394
2020-11-28
3.0.8.33393
2020-11-21
3.0.8.33392
2020-11-20
3.0.8.33391
2020-11-18
3.0.8.33390
2020-11-12
3.0.7.33388
2020-11-07
3.0.7.33387
2020-11-05
3.0.7.33385
2020-11-04
3.0.7.33384
2020-11-03
3.0.7.33383
2020-10-30
3.0.7.33382
2020-10-29
3.0.7.33380
2020-10-24
3.0.7.33379
2020-10-22
3.0.7.33378
2020-10-21
3.0.7.33376
2020-10-20
3.0.7.33375
2020-10-17
3.0.7.33374
2020-10-12
3.0.7.33372
2020-10-10
3.0.7.33371
2020-10-09
3.0.7.33370
2020-10-08
3.0.7.33368
2020-10-08
3.0.7.33367
2020-09-29
3.0.7.33365
2020-09-22
3.0.7.33364
2020-09-20
3.0.7.33362
2020-09-19
3.0.7.33361
2020-09-17
3.0.7.33360
2020-09-11
3.0.7.33359
2020-09-10
3.0.7.33358
2020-08-25
Test TITLE
1 SS P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P
Lot of syntax tests for COALESCE()
2 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P
Buffer overflow in conversion
3 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P     F     P
Buffer overflow in conversion
4 CS P P P P P P P P P P     F     P P P P P P P P P P P P P P P P P P P
Ability to cancel waiting in lock manager
5 CS P P     F         F     P P P P     E         E         E         E     P P P     F         F     P P     F     P P     F     P P P P P P     F    
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
6 CS P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
Performance regression when bulk inserting into table with indices
7 SS P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     P     F         F    
Performance regression when bulk inserting into table with indices
8 CS P P P P P P P     F     P P P P P     F     P P     F     P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
9 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
10 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
11 CS P P P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
12 SS P P P P P P P P P P P P P P P P P P P P P P P P     F         F     P P P P
Check ability to create database with total length of path and file name about maximal allowed limit in Windows

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33396
2020-12-03
3.0.8.33394
2020-11-28
3.0.8.33393
2020-11-21
3.0.8.33392
2020-11-20
3.0.8.33391
2020-11-18
3.0.8.33390
2020-11-12
3.0.7.33388
2020-11-07
3.0.7.33387
2020-11-05
3.0.7.33385
2020-11-04
3.0.7.33384
2020-11-03
3.0.7.33383
2020-10-30
3.0.7.33382
2020-10-29
3.0.7.33380
2020-10-24
3.0.7.33379
2020-10-22
3.0.7.33378
2020-10-21
3.0.7.33376
2020-10-20
3.0.7.33375
2020-10-17
3.0.7.33374
2020-10-12
3.0.7.33372
2020-10-10
3.0.7.33371
2020-10-09
3.0.7.33370
2020-10-08
3.0.7.33368
2020-10-08
3.0.7.33367
2020-09-29
3.0.7.33365
2020-09-22
3.0.7.33364
2020-09-20
3.0.7.33362
2020-09-19
3.0.7.33361
2020-09-17
3.0.7.33360
2020-09-11
3.0.7.33359
2020-09-10
3.0.7.33358
2020-08-25
Test TITLE
1 SS 1314 1000 1000 1319 1310 1339 1300 1369 1299 1350 1380 1340 1329 1299 1299 1299 1299 1310 1309 1319 1319 1339 1299 1330 1299 1309 1379 1329 1339 1310 1319
Lot of syntax tests for COALESCE()
2 CS 1720 1720 1720 1700 1929 1740 1690 2350 1730 1659 1940 1809 1990 1670 1710 1670 1670 1669 1869 1970 1679 1679 1669 1690 1819 1910 1769 1690 1909 1689 1970
Buffer overflow in conversion
3 SS 1129 1109 1120 1220 1119 1169 1139 1000 1120 1120 1160 1120 1139 1170 1120 1119 1139 1120 1119 1000 1129 1129 1120 1130 1210 1140 1410 1130 1129 1129 1180
Buffer overflow in conversion
4 CS 4089 3720 3819 8450 4019 4019 4059 3769 5030 4930 6349 16289 4079 3659 3970 3580 3619 6409 6189 8019 4170 6259 4669 4009 3680 5990 5519 4019 4099 3950 8410
Ability to cancel waiting in lock manager
5 CS 24675 14759 14610 24710 29400 25880 25840 23539 26890 1720 1789 1720 1759 28390 31060 25039 27820 25139 28430 25789 23640 23220 29800 25669 14490 17900 22369 24640 29769 17460 23559
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
6 CS 19049 4000 4230 19849 17839 21730 24410 18579 21509 19699 21710 19509 23980 22349 17820 19769 23980 17319 19480 6220 19049 23230 18299 23940 7960 7869 8470 19049 6309 10109 6139
Performance regression when bulk inserting into table with indices
7 SS 11755 3269 3300 12630 18700 9309 10000 24299 16000 13579 12050 22799 10990 9700 19779 14549 11460 18200 10410 9029 23289 17049 15319 9809 6870 6759 21409 12990 5860 9940 7069
Performance regression when bulk inserting into table with indices
8 CS 24935 24930 24950 24950 24980 24900 24970 24940 24900 24829 25259 24819 24869 24829 24919 24960 24830 24940 24890 24870 24829 24919 24949 24920 24849 24960 25020 24960 25150 25079 24950
Sometime it is impossible to cancel\kill connection executing external query
9 CS 2274 2200 2140 2350 2000 2259 2360 2259 2289 2200 2339 2210 2340 2289 2210 2549 2000 2289 2230 2259 2289 2309 2230 2299 2269 2000 2350 2279 2279 2359 2220
INNER JOIN join order
10 SS 1695 1569 1560 1790 1859 1639 1879 1690 1650 1730 1000 1640 1000 1630 1720 1669 1700 1759 1700 1700 1620 1789 1700 1769 1720 1710 1789 1000 1650 1680 1680
INNER JOIN join order
11 CS 19829 19310 19690 20160 19879 19940 20109 19539 19640 19799 20509 19629 19430 20330 19850 20150 20690 20389 20569 19620 19299 19819 20009 20069 19670 9289 9839 19840 20180 19730 19740
Check ability to create database with total length of path and file name about maximal allowed limit in Windows
12 SS 16264 16060 16210 16460 16449 16269 16859 16259 16230 16259 17730 16860 16619 16350 16000 16240 16129 16129 16980 16360 16180 18049 16420 16199 16160 8589 7399 17059 16869 16940 16170
Check ability to create database with total length of path and file name about maximal allowed limit in Windows

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1712
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-501
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5685
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/tabloid/max-path-length.fbt

=== end of list ===