01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
06. Has fails: tests with at least one fail for previous 30 runs (66 rows)
[CURRENT] 07. Has runtime errors: tests with at least one runtime error for previous 30 runs (6 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (4 rows)
10. All tests: outcomes for previous 30 runs (2024 rows)
11. All tests: durations for previous 30 runs (3966 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 26.03.2024 14:03
Tested: HQ30.   Build: 3.0.12.33726;   SS: 26.03.24 12:43:52 - 26.03.24 13:13:44;   CS: 26.03.24 13:14:35 - 26.03.24 14:01:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "ERROR" for last 30 runs:

NN Test name mode 3.0.12.33726
2024-03-26
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X X X
Test TITLE
1 CS P P P P P P P P P P P E E X X X X X X X X X X X X X X X X X
Make it possible to restore compressed .nbk files without explicitly decompressing them
2 SS P P P P P P P P P P P E E X X X X X X X X X X X X X X X X X
Make it possible to restore compressed .nbk files without explicitly decompressing them
3 CS P P P P P P P E P P P P P X X X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
4 SS P P E X X X X X X X X X X X X X X X X X X X X X X X X X X X
Crash potentially caused by BETWEEN Operator
5 SS P P P P P P P P E P P P P X X X X X X X X X X X X X X X X X
CEIL( <number>)
6 SS P P P P P E X X X X X X X X X X X X X X X X X X X X X X X X
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33726
2024-03-26
3.0.12.33725
2023-12-29
3.0.12.33722
2023-11-28
3.0.12.33712
2023-11-07
3.0.12.33706
2023-09-20
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-22
3.0.11.33685
2023-06-04
3.0.11.33683
2023-05-02
3.0.11.33666
2023-04-17
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-08
3.0.11.33648
2023-01-18
X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 8442 8252 9560 8673 8792 8696 8635 8715 8136 8263 8275 8442 294 293 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make it possible to restore compressed .nbk files without explicitly decompressing them
2 SS 7156 6574 7457 7401 7269 7306 7217 7087 7156 6771 7006 7404 83 59 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make it possible to restore compressed .nbk files without explicitly decompressing them
3 CS 130214 135278 131264 129722 129879 130214 130825 130218 84 130375 129897 131245 129995 127898 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
4 SS 348 260 348 410 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash potentially caused by BETWEEN Operator
5 SS 269 227 326 299 279 269 287 235 242 69 261 224 404 323 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
CEIL( <number>)
6 SS 174 133 229 175 180 173 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-4462
http://tracker.firebirdsql.org/browse/core-5648
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/math/test_ceil_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7860

=== end of list ===