01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
[CURRENT] 03. NEW FAILS: tests which failed for LAST run (4 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (28 rows)
07. Has fails: tests with at least one fail for previous 35 runs (65 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (183 rows)
11. All tests: outcomes for previous 35 runs (2703 rows)
12. Skipped: tests which was intentionally excluded from execution (169 rows)

Generated UTC 01.10.2025 18:11
Tested: HQ40.   Build / date: 4.0.6.3223-970bec8a / 2025.08.18;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with result = "FAIL" for LAST run:

NN Test name mode
4.0.6.3223
2025.08.18
4.0.6.3222
2025.07.22
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.16
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS F P P P P P P P P P P F P P P P P P X X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Get the modification time of a config file with a higher precision to fix cases when it's not reloaded after modification/replacement
3 CS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong SQLSTATE in case of table alias conflict
4 SS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Wrong SQLSTATE in case of table alias conflict

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3223
2025.08.18
4.0.6.3222
2025.07.22
4.0.6.3189
2025.02.25
4.0.6.3184
2025.02.24
4.0.6.3183
2025.02.16
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 554 7303 3714 3746 562 593 558 413 426 462 426 486 882 551 590 408 582 350 344 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS 1011 1011 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Get the modification time of a config file with a higher precision to fix cases when it's not reloaded after modification/replacement
3 CS 873 873 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong SQLSTATE in case of table alias conflict
4 SS 630 630 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong SQLSTATE in case of table alias conflict

List of tests in this report:


https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/8553
https://github.com/FirebirdSQL/firebird/issues/8739
=== end of list ===

Last commits information (all timestamps in UTC):