01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (30 rows)
07. Has fails: tests with at least one fail for previous 30 runs (43 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2445 rows)
12. Skipped: tests which was intentionally excluded from execution (75 rows)

Generated UTC 17.02.2025 08:05
Tested: HQ40.   Build / date: 4.0.6.3183-cf6ca3ce / 2025.02.16;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46
36404 35914 2896 2896 2687 2850 2850 2687 2662 2479 X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46
35889 34659 2445 2445 2395 2445 2445 2487 2395 2385 X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46
523 519 516 7 7 7 9 9 9 8 X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46
396 373 339 11 11 8 10 10 8 8 X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
579 561 541 13 13 7 9 9 7 7 X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
418 383 372 8 8 6 8 8 5 5 X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46
704 672 642 12 12 7 6 6 6 6 X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
449 448 444 15 9 8 9 8 7 7 X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
702 648 632 13 6 6 6 6 6 6 X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
478 478 475 10 8 8 8 8 7 6 X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53
262 258 258 262 277 361 361 361 317 162 X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53
805 785 785 805 843 998 998 998 762 8 X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53
438 405 405 438 462 561 562 562 561 6 X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5431 
 tracker
 SS 2023.02.23 08:18
260 253 253 253 265 324 324 324 311 168 X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
15
bugs core 5463 
 tracker
 CS 2023.07.18 08:54
718 703 685 17 10 10 8 8 7 6 X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
16
bugs core 5463 
 tracker
 SS 2023.07.18 08:54
530 520 519 20 9 9 9 9 7 7 X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs gh 6267 
 tracker
 SS 2024.07.22 17:04
1074 1064 1064 1074 1074 1045 598 X X X X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
18
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06
39829 39829 39829 41537 41537 41537 4807 X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
19
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06
40651 40651 40651 43047 43047 43047 3038 X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 7140 
 tracker
 CS 2024.12.29 06:59
2933 2933 2933 2937 3021 3217 3217 3217 2869 640 X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
21
bugs gh 7140 
 tracker
 SS 2024.12.29 06:59
2699 2680 2667 2680 2680 2771 2771 2771 2616 450 X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
22
bugs gh 7186 
 tracker
 SS 2023.03.03 21:49
16056 15826 15826 16056 16225 22736 23605 23605 22736 6131 X X X X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
23
bugs gh 7761 
 tracker
 CS 2023.09.27 21:01
32952 32676 32676 32676 34070 34070 34070 1719 1134 1104 X X X X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
24
bugs gh 7761 
 tracker
 SS 2023.09.27 21:01
28916 28693 28693 28916 30890 30890 30890 1063 905 804 X X X X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
25
functional intfunc string left 01 
 CS 2022.02.04 18:05
4211 4046 4013 11 11 11 11 9 9 9 X X X X X X X X X X X X X X X X
LEFT function
26
functional intfunc string left 01 
 SS 2022.02.04 18:05
4290 3942 3929 12 9 7 7 7 7 7 X X X X X X X X X X X X X X X X
LEFT function
27
functional intfunc string right 01 
 CS 2022.02.04 18:05
4244 4131 3999 16 14 10 10 10 10 10 X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
28
functional intfunc string right 01 
 SS 2022.02.04 18:05
4128 3867 3859 8 8 6 8 8 6 6 X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
29
functional intfunc string trunc 01 
 CS 2023.03.10 09:39
3497 3453 3453 3453 3453 1826 1087 681 581 474 X X X X X X X X X X X X X X X X
Test for TRUNC function
30
functional intfunc string trunc 01 
 SS 2023.03.10 09:39
3051 3027 3027 3011 2935 1276 509 508 413 319 X X X X X X X X X X X X X X X X
Test for TRUNC function

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3183
2025.02.16
cf6ca
4.0.6.3169
2024.12.13
42cc1
4.0.6.3169
2024.12.08
50eb6
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46 47826 45087 35914 36404 2558 2362 2896 5841 2687 2850 2377 2662 2479 2401 X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46 47509 44055 35889 34659 2359 2285 2445 3867 2395 2487 2385 2518 2319 2242 X X X X X X X X X X X X X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46 737 654 516 519 523 6 5 7 9 9 9 5 8 7 X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46 423 466 373 339 396 5 7 11 13 8 10 5 6 9 X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 714 722 579 541 561 5 6 13 13 7 9 7 7 7 X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 494 469 418 372 383 6 6 8 9 5 9 5 5 7 X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2216 
 tracker
 CS 2022.02.02 14:46 913 763 704 642 672 7 6 12 13 5 5 6 7 6 X X X X X X X X X X X X X X X X
Nbackup as online dump
8
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 611 594 449 448 444 5 9 15 8 7 11 6 6 8 X X X X X X X X X X X X X X X X
Nbackup as online dump
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 747 895 632 648 702 5 6 13 5 6 4 7 6 5 X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 620 588 478 475 478 8 5 10 8 7 11 5 5 6 X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 4054 
 tracker
 SS 2024.06.09 15:53 362 335 258 262 218 240 277 580 362 361 162 317 158 151 X X X X X X X X X X X X X X X X
role not passed on external execute stmt
12
bugs core 5225 
 tracker
 CS 2024.06.09 15:53 996 1024 776 805 785 783 843 1424 998 1131 762 8 7 5 X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
13
bugs core 5225 
 tracker
 SS 2024.06.09 15:53 573 517 405 405 438 394 462 772 561 642 562 6 5 5 X X X X X X X X X X X X X X X X
Authentication end with first plugin that has the user but auth fails; should continue with next plugin
14
bugs core 5431 
 tracker
 SS 2023.02.23 08:18 331 337 260 247 253 220 265 523 335 324 168 311 128 134 X X X X X X X X X X X X X X X X
Support for DROP IDENTITY clause
15
bugs core 5463 
 tracker
 CS 2023.07.18 08:54 894 940 703 718 685 17 6 10 7 11 8 6 6 6 X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
16
bugs core 5463 
 tracker
 SS 2023.07.18 08:54 730 641 520 519 530 7 6 20 9 11 7 6 6 7 X X X X X X X X X X X X X X X X
Support GENERATED ALWAYS identity columns and OVERRIDE clause
17
bugs gh 6267 
 tracker
 SS 2024.07.22 17:04 1496 1458 1049 1064 1074 1045 1103 1970 566 598 388 X X X X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
18
bugs gh 6609 
 tracker
 CS 2024.12.24 08:06 57676 54558 39750 39301 39829 41537 45033 93011 3507 4807 2957 X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
19
bugs gh 6609 
 tracker
 SS 2024.12.24 08:06 57063 57340 39595 39799 40651 43047 45948 96442 2960 3038 2578 X X X X X X X X X X X X X X X X X X X
Memory leak at server, when client select computed field, which used COALESCE or CAST [CORE6370]
20
bugs gh 7140 
 tracker
 CS 2024.12.29 06:59 3154 3127 2933 2894 2929 2937 3021 3496 3217 3646 2869 640 422 390 X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
21
bugs gh 7140 
 tracker
 SS 2024.12.29 06:59 2768 2720 2664 2699 2667 2680 2666 3082 2823 2771 2616 450 259 303 X X X X X X X X X X X X X X X X
Wrong select result in case of special sort character
22
bugs gh 7186 
 tracker
 SS 2023.03.03 21:49 27770 27116 15826 15214 16056 14356 16225 46525 23859 22736 23605 6131 5547 5485 X X X X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
23
bugs gh 7761 
 tracker
 CS 2023.09.27 21:01 45393 42498 32952 30062 32676 31136 38224 66439 34070 1719 1104 1134 881 897 X X X X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
24
bugs gh 7761 
 tracker
 SS 2023.09.27 21:01 40004 38303 28693 27307 28916 27865 33262 55534 30890 1063 754 905 804 712 X X X X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
25
functional intfunc string left 01 
 CS 2022.02.04 18:05 4615 4211 4046 4013 4301 6 11 11 9 20 9 5 11 5 X X X X X X X X X X X X X X X X
LEFT function
26
functional intfunc string left 01 
 SS 2022.02.04 18:05 4362 4290 3942 4636 3929 6 7 12 9 6 7 7 7 7 X X X X X X X X X X X X X X X X
LEFT function
27
functional intfunc string right 01 
 CS 2022.02.04 18:05 5287 4244 4131 3999 4249 5 6 16 14 10 10 5 11 5 X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
28
functional intfunc string right 01 
 SS 2022.02.04 18:05 4583 4223 3859 4128 3867 6 5 8 9 5 9 5 6 7 X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
29
functional intfunc string trunc 01 
 CS 2023.03.10 09:39 3800 3653 3426 3416 3497 3453 3560 1087 681 1826 474 581 388 402 X X X X X X X X X X X X X X X X
Test for TRUNC function
30
functional intfunc string trunc 01 
 SS 2023.03.10 09:39 3325 3312 3027 3051 3011 2935 3114 1276 509 508 319 413 280 253 X X X X X X X X X X X X X X X X
Test for TRUNC function

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-5225
http://tracker.firebirdsql.org/browse/CORE-5431
http://tracker.firebirdsql.org/browse/CORE-5463
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_trunc_01.py
https://github.com/FirebirdSQL/firebird/issues/6267
https://github.com/FirebirdSQL/firebird/issues/6609
https://github.com/FirebirdSQL/firebird/issues/7140
https://github.com/FirebirdSQL/firebird/issues/7186
https://github.com/FirebirdSQL/firebird/issues/7761
=== end of list ===

Last commits information (all timestamps in UTC):