01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (3 rows)
03. NEW FAILS: tests which failed for LAST run (25 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (9 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (6 rows)
06. Has fails: tests with at least one fail for previous 30 runs (93 rows)
[CURRENT] 07. Has runtime errors: tests with at least one runtime error for previous 30 runs (15 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (3 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2062 rows)
11. All tests: durations for previous 30 runs (3974 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 12.05.2024 19:14
Tested: HQ30.   Build: 3.0.12.33744;   SS: 12.05.24 17:42:19 - 12.05.24 18:16:50;   CS: 12.05.24 18:17:31 - 12.05.24 19:11:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "ERROR" for last 30 runs:

NN Test name mode 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0001 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Server shutdown
2
bugs core 1076 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Services Manager and gsec truncate First.Middle.Last Name fields to 17 chars instead of 32 chars available in field definition
3
bugs core 1148 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Every user can view server log using services API
4
bugs core 4342 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Non-privileged user can delete records from RDB$SECURITY_CLASSES table
5
bugs core 4430 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Properties of user created in Legacy_UserManager padded with space up to 10 character
6
bugs core 4462 linux 
 tracker
 CS P P P P P P P P P P P P P E E X X X X X X X X X X X X X X X
Make it possible to restore compressed .nbk files without explicitly decompressing them
7
bugs core 4462 linux 
 tracker
 SS P P P P P P P P P P P P P E E X X X X X X X X X X X X X X X
Make it possible to restore compressed .nbk files without explicitly decompressing them
8
bugs core 4464 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Duplicate tags for CREATE/ALTER USER not handled correctly
9
bugs core 4469 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Add field in SEC$USERS reflecting whether a user has RDB$ADMIN role in security database
10
bugs core 4503 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
ISQL command SHOW USERS display only me
11
bugs core 4802 
 tracker
 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Regression: GRANT UPDATE(<some_column>) on <T> acts like grant update on ALL columns of <T>
12
bugs core 5648 
 tracker
 CS P P P P P P P P P E P P P P P X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
13
bugs gh 7860 
 tracker
 SS P P P P E X X X X X X X X X X X X X X X X X X X X X X X X X
Crash potentially caused by BETWEEN Operator
14
functional intfunc math ceil 01 
 SS P P P P P P P P P P E P P P P X X X X X X X X X X X X X X X
CEIL( <number>)
15
functional tabloid crash when too long username for auth 
 SS P P P P P P P E X X X X X X X X X X X X X X X X X X X X X X
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0001 
 tracker
 CS 1238 873 1582 1367 1488 1250 1238 1289 1250 1156 1130 1234 1232 1119 1431 1216 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server shutdown
2
bugs core 1076 
 tracker
 CS 1530 977 1873 1533 1731 1602 1548 1530 1537 1460 1427 1408 1411 1492 1665 1366 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Services Manager and gsec truncate First.Middle.Last Name fields to 17 chars instead of 32 chars available in field definition
3
bugs core 1148 
 tracker
 CS 1147 825 1413 1147 1363 1202 1091 1188 1121 1212 1165 1060 1133 1023 1361 1087 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Every user can view server log using services API
4
bugs core 4342 
 tracker
 CS 2316 3012 2903 2275 2679 2195 2169 2446 2288 2388 2215 2316 2469 2221 2457 1799 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-privileged user can delete records from RDB$SECURITY_CLASSES table
5
bugs core 4430 
 tracker
 CS 1134 897 1329 1303 1414 1194 1177 1123 1134 1096 1013 1065 1164 1020 1341 1063 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Properties of user created in Legacy_UserManager padded with space up to 10 character
6
bugs core 4462 linux 
 tracker
 CS 8673 10298 9132 9066 9560 8673 8792 8696 8635 8715 8136 8263 8275 8442 294 293 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make it possible to restore compressed .nbk files without explicitly decompressing them
7
bugs core 4462 linux 
 tracker
 SS 7161 7341 7161 6978 7457 7401 7269 7306 7217 7087 7156 6771 7006 7404 83 59 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make it possible to restore compressed .nbk files without explicitly decompressing them
8
bugs core 4464 
 tracker
 CS 1574 1443 1846 1630 2174 1545 1574 1620 1592 1569 1382 1539 1601 1419 1912 1463 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Duplicate tags for CREATE/ALTER USER not handled correctly
9
bugs core 4469 
 tracker
 CS 1627 1240 1722 1594 1808 1686 1724 1680 1651 1627 1375 1558 1613 1470 1759 1433 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add field in SEC$USERS reflecting whether a user has RDB$ADMIN role in security database
10
bugs core 4503 
 tracker
 CS 4748 893 5674 4856 5766 4729 4916 4748 4818 4816 4191 4474 4674 4374 4780 3784 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL command SHOW USERS display only me
11
bugs core 4802 
 tracker
 CS 4065 5597 4975 4125 5096 4065 3994 4122 4214 3954 3761 3931 3920 3531 4139 3172 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: GRANT UPDATE(<some_column>) on <T> acts like grant update on ALL columns of <T>
12
bugs core 5648 
 tracker
 CS 130218 134452 135172 135605 131264 129722 129879 130214 130825 130218 84 130375 129897 131245 129995 127898 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
13
bugs gh 7860 
 tracker
 SS 323 323 291 252 348 410 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash potentially caused by BETWEEN Operator
14
functional intfunc math ceil 01 
 SS 279 287 305 211 326 299 279 269 287 235 242 69 261 224 404 323 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
CEIL( <number>)
15
functional tabloid crash when too long username for auth 
 SS 175 202 176 150 229 175 180 173 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1
http://tracker.firebirdsql.org/browse/core-1076
http://tracker.firebirdsql.org/browse/core-1148
http://tracker.firebirdsql.org/browse/core-4342
http://tracker.firebirdsql.org/browse/core-4430
http://tracker.firebirdsql.org/browse/core-4462
http://tracker.firebirdsql.org/browse/core-4464
http://tracker.firebirdsql.org/browse/core-4469
http://tracker.firebirdsql.org/browse/core-4503
http://tracker.firebirdsql.org/browse/core-4802
http://tracker.firebirdsql.org/browse/core-5648
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/math/test_ceil_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7860

=== end of list ===