01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (3 rows)
03. NEW FAILS: tests which failed for LAST run (25 rows)
[CURRENT] 04. NEW ERRORS: tests which raised runtime error for LAST run (9 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (6 rows)
06. Has fails: tests with at least one fail for previous 30 runs (93 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (15 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (3 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2062 rows)
11. All tests: durations for previous 30 runs (3974 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 12.05.2024 19:14
Tested: HQ30.   Build: 3.0.12.33744;   SS: 12.05.24 17:42:19 - 12.05.24 18:16:50;   CS: 12.05.24 18:17:31 - 12.05.24 19:11:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests with result = "ERROR" for last run:

NN Test name mode 3.0.12.33744
2024-05-12
3.0.12.33740
2024-04-20
3.0.12.33726
2024-04-04
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X
Test TITLE
1 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Server shutdown
2 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Services Manager and gsec truncate First.Middle.Last Name fields to 17 chars instead of 32 chars available in field definition
3 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Every user can view server log using services API
4 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Non-privileged user can delete records from RDB$SECURITY_CLASSES table
5 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Properties of user created in Legacy_UserManager padded with space up to 10 character
6 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Duplicate tags for CREATE/ALTER USER not handled correctly
7 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Add field in SEC$USERS reflecting whether a user has RDB$ADMIN role in security database
8 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
ISQL command SHOW USERS display only me
9 CS E P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Regression: GRANT UPDATE(<some_column>) on <T> acts like grant update on ALL columns of <T>

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33744
2024-05-12
3.0.12.33740
2024-04-20
3.0.12.33726
2024-04-04
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X
Test TITLE
1 CS 1238 873 1582 1367 1488 1250 1238 1289 1250 1156 1130 1234 1232 1119 1431 1216 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server shutdown
2 CS 1530 977 1873 1533 1731 1602 1548 1530 1537 1460 1427 1408 1411 1492 1665 1366 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Services Manager and gsec truncate First.Middle.Last Name fields to 17 chars instead of 32 chars available in field definition
3 CS 1147 825 1413 1147 1363 1202 1091 1188 1121 1212 1165 1060 1133 1023 1361 1087 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Every user can view server log using services API
4 CS 2316 3012 2903 2275 2679 2195 2169 2446 2288 2388 2215 2316 2469 2221 2457 1799 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Non-privileged user can delete records from RDB$SECURITY_CLASSES table
5 CS 1134 897 1329 1303 1414 1194 1177 1123 1134 1096 1013 1065 1164 1020 1341 1063 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Properties of user created in Legacy_UserManager padded with space up to 10 character
6 CS 1574 1443 1846 1630 2174 1545 1574 1620 1592 1569 1382 1539 1601 1419 1912 1463 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Duplicate tags for CREATE/ALTER USER not handled correctly
7 CS 1627 1240 1722 1594 1808 1686 1724 1680 1651 1627 1375 1558 1613 1470 1759 1433 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add field in SEC$USERS reflecting whether a user has RDB$ADMIN role in security database
8 CS 4748 893 5674 4856 5766 4729 4916 4748 4818 4816 4191 4474 4674 4374 4780 3784 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL command SHOW USERS display only me
9 CS 4065 5597 4975 4125 5096 4065 3994 4122 4214 3954 3761 3931 3920 3531 4139 3172 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: GRANT UPDATE(<some_column>) on <T> acts like grant update on ALL columns of <T>

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1
http://tracker.firebirdsql.org/browse/core-1076
http://tracker.firebirdsql.org/browse/core-1148
http://tracker.firebirdsql.org/browse/core-4342
http://tracker.firebirdsql.org/browse/core-4430
http://tracker.firebirdsql.org/browse/core-4464
http://tracker.firebirdsql.org/browse/core-4469
http://tracker.firebirdsql.org/browse/core-4503
http://tracker.firebirdsql.org/browse/core-4802

=== end of list ===