01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (8 rows)
07. Has fails: tests with at least one fail for previous 30 runs (8 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2443 rows)
12. Skipped: tests which was intentionally excluded from execution (64 rows)

Generated UTC 17.01.2025 06:30
Tested: FB40.   Build / date: 4.0.6.3176-79cc1f11 / 2025.01.16;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
4.0.6.3174
2024.12.23
4.0.6.3173
2024.12.19
4.0.6.3172
2024.12.11
4.0.6.3171
2024.12.10
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
4.0.6.3168
2024.11.27
4.0.6.3168
2024.11.07
4.0.6.3167
2024.11.04
4.0.6.3165
2024.10.23
4.0.6.3164
2024.10.17
4.0.6.3161
2024.10.05
4.0.6.3159
2024.10.01
4.0.6.3158
2024.09.30
4.0.6.3157
2024.09.24
4.0.6.3156
2024.09.21
4.0.6.3155
2024.09.20
4.0.6.3151
2024.09.09
4.0.6.3149
2024.09.04
4.0.6.3148
2024.09.02
4.0.6.3147
2024.08.30
4.0.6.3146
2024.08.27
4.0.6.3145
2024.08.21
4.0.6.3144
2024.08.20
Test TITLE
1 CS 2024.12.03 09:08
21776 21776 21878 21878 21775 21775 2283 2283 2271 2271 2252 2240 2230 2224 2230 2230 2243 2247 2264 2247 2247 2242 2242 2242 2308 2334
Count (DISTINCT ...) is too slow
2 SS 2024.12.03 09:08
21624 21624 21156 21267 21156 21156 1988 1988 1988 1992 1992 1995 1993 1993 1993 2003 1994 2003 2003 2010 2041 2041 2001 2044 2044 1992
Count (DISTINCT ...) is too slow
3 SS 2024.08.23 12:01
779 780 780 782 782 780 774 780 780 775 797 797 790 784 790 784 784 786 793 786 786 780 774 578 568 565
Can't create table using long username and UTF8 as attachment charset
4 SS 2022.02.02 14:46
681 681 709 709 732 732 734 732 688 674 468 468 468 438 436 736 721 682 721 721 721 683 683 583 481 471
Offset value for SUBSTRING from BLOB more than 32767 makes exception
5 SS 2024.11.19 07:13
588 584 584 584 583 583 583 576 432 431 425 431 432 425 436 436 426 426 436 426 429 429 429 429 467 467
Regression: could not execute query (select from view with nested view)
6 SS 2023.12.13 11:05
5323 5364 5364 5364 5364 5275 5251 5202 5202 4345 3211 3211 3260 3260 4284 5074 4284 5246 5246 5241 5085 5241 5241 5251 5624 5624
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
7 CS 2024.08.22 13:09
5141 5186 5141 5186 5141 5144 5144 5148 5144 5148 5156 5170 5191 5195 5191 5191 5166 5166 5156 5166 5166 5155 5109 2794 2794 2769
Improve performance of CURRENT_TIME
8 SS 2024.08.22 13:09
4883 4914 4915 4915 4915 4904 4904 4887 4887 4881 4881 4881 4887 4929 4943 4943 4929 4943 4943 4884 4883 4883 4878 2464 2464 2438
Improve performance of CURRENT_TIME

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3176
2025.01.16
4.0.6.3175
2025.01.15
4.0.6.3174
2024.12.23
4.0.6.3173
2024.12.19
4.0.6.3172
2024.12.11
4.0.6.3171
2024.12.10
4.0.6.3170
2024.12.02
4.0.6.3169
2024.11.28
4.0.6.3168
2024.11.27
4.0.6.3168
2024.11.07
4.0.6.3167
2024.11.04
4.0.6.3165
2024.10.23
4.0.6.3164
2024.10.17
4.0.6.3161
2024.10.05
4.0.6.3159
2024.10.01
4.0.6.3158
2024.09.30
4.0.6.3157
2024.09.24
4.0.6.3156
2024.09.21
4.0.6.3155
2024.09.20
4.0.6.3151
2024.09.09
4.0.6.3149
2024.09.04
4.0.6.3148
2024.09.02
4.0.6.3147
2024.08.30
4.0.6.3146
2024.08.27
4.0.6.3145
2024.08.21
4.0.6.3144
2024.08.20
4.0.6.3142
2024.08.11
4.0.6.3141
2024.08.09
4.0.5.3140
2024.08.06
4.0.5.3139
2024.08.01
Test TITLE
1 CS 2024.12.03 09:08 21825 21776 21483 22083 21605 21878 22620 21775 2225 2271 2283 2491 2252 2203 2240 2224 2230 2222 2264 2243 2247 2404 2287 2242 2234 2219 2334 2477 2308 2749
Count (DISTINCT ...) is too slow
2 SS 2024.12.03 09:08 21648 21624 21026 21657 21056 21627 21156 21267 1972 1977 1988 1995 1992 2443 1989 2005 1993 1991 2003 2010 1994 2041 2001 2521 2345 1959 1992 2044 2134 1983
Count (DISTINCT ...) is too slow
3 SS 2024.08.23 12:01 774 779 779 780 782 782 774 783 780 774 770 807 838 775 797 790 775 784 793 782 786 800 815 780 774 532 565 578 568 455
Can't create table using long username and UTF8 as attachment charset
4 SS 2022.02.02 14:46 436 436 715 681 709 422 734 732 833 688 743 674 468 438 436 913 901 426 425 736 721 682 770 683 757 425 583 471 481 348
Offset value for SUBSTRING from BLOB more than 32767 makes exception
5 SS 2024.11.19 07:13 610 594 581 588 584 576 584 576 583 586 423 431 432 425 416 438 438 425 436 426 421 453 452 421 429 426 470 467 472 345
Regression: could not execute query (select from view with nested view)
6 SS 2023.12.13 11:05 5230 3249 5323 7109 6289 5364 5251 5275 6311 5202 4345 3211 6389 3134 3081 5074 3260 4284 5246 5332 4246 5346 5085 5241 4213 5251 5624 6354 6378 4203
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
7 CS 2024.08.22 13:09 5072 5193 5054 5186 5141 5236 5141 5339 5141 5144 5156 5148 5137 5207 5170 5249 5191 5195 5156 5152 5166 5312 5155 5193 5109 2794 2747 2769 3172 2592
Improve performance of CURRENT_TIME
8 SS 2024.08.22 13:09 4883 4819 4853 4914 4921 4930 4915 4904 4887 4871 4955 4881 4887 4844 4870 4959 4929 5108 4943 4884 4869 5048 5207 4883 4878 2409 2464 2438 2580 2310
Improve performance of CURRENT_TIME

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1292
http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-2211
http://tracker.firebirdsql.org/browse/CORE-5381
http://tracker.firebirdsql.org/browse/CORE-6142
https://github.com/FirebirdSQL/firebird/issues/7092
=== end of list ===

Last commits information (all timestamps in UTC):