0. Total results for each kind of outcome and server mode
1. ERRORS MAP: distribution of Firebird errors which occured during runs (3 rows)
2. FRESH FAILS: tests which failed for LAST execution only (0 rows)
3. FRESH ERRORS: tests which raised run-time error for LAST execution only (0 rows)
4. STILL FAILS: tests which fail for at least two last runs (2 rows)
[CURRENT] 5. Has fails: tests with at least one fail for previous runs (12 rows)
6. Has runtime errors: tests with at least one runtime error for previous runs (60 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (6 rows)
8. All tests: outcomes (3806 rows)
9. All tests: durations (3815 rows)
A. Skipped: tests which was intentionally excluded from execution (6 rows)

Generated 07.03.2021 13:55
Tested (major version): FB30
OS and hardware info:  Windows 2008ServerR2 6.1.7601 ; logical CPUs: 4 ; total memory: 8.0 Gb 

Test with at least one result = "FAIL" for last 30 runs:
NN Test name mode 3.0.8.33423
2021-03-07		 3.0.8.33421
2021-03-03		 3.0.8.33420
2021-03-01		 3.0.8.33418
2021-02-18		 3.0.8.33416
2021-02-16		 3.0.8.33415
2021-02-13		 3.0.8.33414
2021-02-05		 3.0.8.33413
2021-02-04		 3.0.8.33411
2021-02-01		 3.0.8.33409
2021-01-31		 3.0.8.33407
2021-01-30		 3.0.8.33404
2021-01-27		 3.0.8.33403
2021-01-25		 3.0.8.33402
2020-12-28		 3.0.8.33401
2020-12-17		 3.0.8.33400
2020-12-11		 3.0.8.33399
2020-12-10		 3.0.8.33398
2020-12-06		 3.0.8.33396
2020-12-03		 3.0.8.33394
2020-11-28		 3.0.8.33393
2020-11-21		 3.0.8.33392
2020-11-20		 3.0.8.33391
2020-11-18		 3.0.8.33390
2020-11-12		 3.0.7.33388
2020-11-07		 3.0.7.33387
2020-11-05		 3.0.7.33385
2020-11-04		 3.0.7.33384
2020-11-03		 3.0.7.33383
2020-10-30		 3.0.7.33382
2020-10-29
Test TITLE
1
bugs core 0501
tracker
 SS P P P P P P P P P P P P P P P P P P P P P P     F     P P P P P P P
Lot of syntax tests for COALESCE()
2
bugs core 1885
tracker
 CS P     F     P P P P P P P P P P P P X X X P P P P P P P P P P P P P
CREATE COLLATION connection lost under Posix
3
bugs core 1885
tracker
 SS P     F     P P P P P P P P P P P P P P P P P P P P P P P P P P P P
CREATE COLLATION connection lost under Posix
4
bugs core 3323
tracker
 CS P P P P P P P P P P P P P P X X X P P P P P P P P P P P     F     P
Ability to cancel waiting in lock manager
5
bugs core 5087
tracker
 CS P P P P P P P P P P P P P P X X X P P P     F         F     P P P P     E         E         E         E    
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
6
bugs core 5302
tracker
 CS P P P P P P P P P P P P P P X X X P P P     F         F         F         F         F         F         F         F         F         F    
Performance regression when bulk inserting into table with indices
7
bugs core 5302
tracker
 SS P P P P P P P P P P P P P P P P P P P P     F         F         F         F         F         F         F         F         F         F    
Performance regression when bulk inserting into table with indices
8
bugs core 5685
tracker
 CS P P     F     P P P     F     P P P P P P P X X X P P P P P P P P     F     P P P P
Sometime it is impossible to cancel\kill connection executing external query
9
bugs core 5685
tracker
 SS P P P P     F     P P P P P P P P P P P P P P P P P P P P P P P P P
Sometime it is impossible to cancel\kill connection executing external query
10
bugs core 6163
tracker
 CS P P     F     P P P P P P P P P P P X X X P P P P P P P P P P P P P
Generator pages are not encrypted
11
optimizer opt inner join 03
 CS     F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X     F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order
12
optimizer opt inner join 03
 SS     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F    
INNER JOIN join order

Elapsed time, milliseconds:
NN Test name mode median_ms 3.0.8.33423
2021-03-07		 3.0.8.33421
2021-03-03		 3.0.8.33420
2021-03-01		 3.0.8.33418
2021-02-18		 3.0.8.33416
2021-02-16		 3.0.8.33415
2021-02-13		 3.0.8.33414
2021-02-05		 3.0.8.33413
2021-02-04		 3.0.8.33411
2021-02-01		 3.0.8.33409
2021-01-31		 3.0.8.33407
2021-01-30		 3.0.8.33404
2021-01-27		 3.0.8.33403
2021-01-25		 3.0.8.33402
2020-12-28		 3.0.8.33401
2020-12-17		 3.0.8.33400
2020-12-11		 3.0.8.33399
2020-12-10		 3.0.8.33398
2020-12-06		 3.0.8.33396
2020-12-03		 3.0.8.33394
2020-11-28		 3.0.8.33393
2020-11-21		 3.0.8.33392
2020-11-20		 3.0.8.33391
2020-11-18		 3.0.8.33390
2020-11-12		 3.0.7.33388
2020-11-07		 3.0.7.33387
2020-11-05		 3.0.7.33385
2020-11-04		 3.0.7.33384
2020-11-03		 3.0.7.33383
2020-10-30		 3.0.7.33382
2020-10-29
Test TITLE
1
bugs core 0501
tracker
 SS 1374 1430 1440 1430 1430 1509 1410 1430 1420 1480 1379 1440 1400 1409 1259 1269 1000 1270 1409 1000 1000 1319 1310 1339 1300 1369 1299 1350 1380 1340 1329
Lot of syntax tests for COALESCE()
2
bugs core 1885
tracker
 CS 1309 1289 1369 1299 1330 1319 1570 1319 1269 1310 1269 1300 1309 1309 1299 1309 1309 1309 1279 1319 1359 1259 1420 1239 1240 1299 1259 1289
CREATE COLLATION connection lost under Posix
3
bugs core 1885
tracker
 SS 914 970 980 1039 1049 1039 1059 1039 970 1019 979 960 990 950 889 880 860 860 889 919 950 859 859 880 909 850 849 869 889 890 859
CREATE COLLATION connection lost under Posix
4
bugs core 3323
tracker
 CS 4170 4000 4289 4329 4139 4219 5209 4580 3849 4759 4170 4920 4079 4469 3900 3769 3720 3819 8450 4019 4019 4059 3769 5030 4930 6349 16289 4079
Ability to cancel waiting in lock manager
5
bugs core 5087
tracker
 CS 12619 12369 12650 13460 12190 12619 12110 12410 12119 12430 12210 13180 12179 14000 13470 12529 14759 14610 24710 29400 25880 25840 23539 26890 1720 1789 1720 1759
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
6
bugs core 5302
tracker
 CS 4290 4099 4259 4039 4210 4150 4000 4109 4290 4440 4509 4279 4220 4019 4319 4110 4000 4230 19849 17839 21730 24410 18579 21509 19699 21710 19509 23980
Performance regression when bulk inserting into table with indices
7
bugs core 5302
tracker
 SS 3764 3819 3539 3799 3680 3599 3740 3769 3990 3730 3509 3819 3759 3000 3529 3490 3470 3619 3579 3269 3300 12630 18700 9309 10000 24299 16000 13579 12050 22799 10990
Performance regression when bulk inserting into table with indices
8
bugs core 5685
tracker
 CS 24980 25120 25290 25159 25029 24990 24990 25080 25009 24990 24970 25150 25029 25090 24929 24859 24930 24950 24950 24980 24900 24970 24940 24900 24829 25259 24819 24869
Sometime it is impossible to cancel\kill connection executing external query
9
bugs core 5685
tracker
 SS 24669 24960 24919 24019 24840 24870 24849 24980 24859 24829 24800 24789 24869 24799 23720 24699 24649 24650 24669 24000 23919 24700 24640 24670 24610 24629 24609 24599 24660 24609 24650
Sometime it is impossible to cancel\kill connection executing external query
10
bugs core 6163
tracker
 CS 2859 3540 4339 3140 2850 2859 2919 3009 3099 2859 2829 2849 2869 3099 2859 2000 2830 2819 2870 2940 2789 2870 2799 2759 2810 2880 2760 2869
Generator pages are not encrypted
11
optimizer opt inner join 03
 CS 2220 2160 2430 2240 2200 2180 2190 2220 2119 2190 2000 2240 2230 2490 2180 2230 2200 2140 2350 2000 2259 2360 2259 2289 2200 2339 2210 2340
INNER JOIN join order
12
optimizer opt inner join 03
 SS 1700 1769 1710 1000 1740 1759 1720 1820 1700 1740 1710 1690 1720 1710 1529 1700 1569 1580 1490 1569 1560 1790 1859 1639 1879 1690 1650 1730 1000 1640 1000
INNER JOIN join order

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1885
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-501
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5685
http://tracker.firebirdsql.org/browse/core-6163
https://github.com/FirebirdSQL/fbt-repository/blob/master/tests/functional/arno/optimizer/opt_inner_join_03.fbt

=== end of list ===