01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (17 rows)
07. Has fails: tests with at least one fail for previous 30 runs (24 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2434 rows)
12. Skipped: tests which was intentionally excluded from execution (72 rows)

Generated UTC 21.11.2024 04:23
Tested: FB40.   Build / date: 4.0.6.3168-f67e22f8 / 2024.11.07;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
Test TITLE
1
bugs core 0655 
 tracker
 SS 2022.02.02 14:46
319 329 329 329 329 328 313 313 352 444 502 510 510 559 559 508 444 410 366 234 234 234 223 237 239 261
Blob Type 1 compatibility with VarChar
2
bugs core 0856 
 tracker
 SS 2022.02.02 14:46
365 19 7 7 6 6 6 6 6 7 9 9 9 9 11 11 11 11 10 9 9 9 9 8 8 7
Unable to set FName, MName, LName fields in security to blank
3
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
514 18 17 7 7 7 6 6 7 8 8 9 9 9 9 9 8 8 8 6 6 6 6 7 13 13
ISQL crash when converted-from-double string longer than 23 bytes
4
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
352 24 12 7 7 6 6 6 7 9 11 12 12 13 13 12 8 7 6 7 6 6 6 6 6 6
ISQL crash when converted-from-double string longer than 23 bytes
5
bugs core 2216 
 tracker
 CS 2022.02.02 14:46
631 11 9 5 5 7 6 6 7 7 8 8 8 8 8 7 7 6 6 6 6 6 10 10 10 10
Nbackup as online dump
6
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
426 25 6 6 7 7 7 7 7 9 10 10 10 10 10 9 8 8 8 7 7 7 6 6 7 6
Nbackup as online dump
7
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
443 10 6 6 6 6 6 6 6 6 7 9 12 12 12 12 8 8 8 8 9 9 8 8 8 7
ASCII_VAL raises error instead of return 0 for empty strings
8
bugs core 3973 
 tracker
 SS 2023.12.11 15:18
1695 1681 1695 1703 1703 1721 1721 1650 1650 1173 986 1173 1173 1096 962 875 773 747 747 704 773 686 647 592 647 647
Original table name and column name and owner missing from SQLDA for aliased column in grouped query
9
bugs core 5463 
 tracker
 SS 2023.07.18 08:54
509 29 5 5 8 8 6 8 8 8 10 10 11 11 10 8 8 7 7 7 7 7 7 6 6 6
Support GENERATED ALWAYS identity columns and OVERRIDE clause
10
bugs core 6219 
 tracker
 SS 2022.02.02 14:46
268 270 270 270 272 267 267 288 330 428 456 459 466 479 479 466 360 354 296 198 189 180 189 189 195 197
Add support for special (inf/nan) values when sorting DECFLOAT values
11
bugs gh 8211 
 tracker
 SS 2024.08.11 06:18
14885 14885 15344 15344 15765 16076 15765 16076 16308 16308 15168 906 862 624 624 X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
12
functional intfunc string left 01 
 CS 2022.02.04 18:05
3901 11 11 8 8 7 6 6 7 11 11 11 11 11 10 9 9 9 9 9 9 7 6 6 6 6
LEFT function
13
functional intfunc string left 01 
 SS 2022.02.04 18:05
3822 8 5 5 6 6 6 6 7 8 11 11 12 11 11 9 8 7 6 6 6 7 6 6 5 5
LEFT function
14
functional intfunc string right 01 
 CS 2022.02.04 18:05
3925 12 12 6 6 6 6 6 7 9 10 10 13 13 9 9 9 9 9 9 9 7 7 7 7 7
RIGHT( <string>, <number> )
15
functional intfunc string right 01 
 SS 2022.02.04 18:05
3727 8 6 6 7 6 7 7 7 11 11 11 11 11 10 9 8 8 7 7 7 7 7 5 10 6
RIGHT( <string>, <number> )
16
functional intfunc string trunc 01 
 CS 2023.03.10 09:39
3614 3625 3631 3631 3750 3750 3672 3672 3750 3672 3672 906 906 906 906 839 687 664 655 477 443 443 424 424 424 431
Test for TRUNC function
17
functional intfunc string trunc 01 
 SS 2023.03.10 09:39
3151 3125 3125 3156 3125 3156 3218 3218 3234 3234 3218 845 781 728 728 728 497 483 477 310 310 305 310 310 304 304
Test for TRUNC function

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3163
2024.10.14
2e35e
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
d2c33
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
4.0.5.3123
2024.06.24
c27c6
4.0.5.3112
2024.06.13
d2e61
4.0.5.3098
2024.05.09
4c3ec
Test TITLE
1
bugs core 0655 
 tracker
 SS 2022.02.02 14:46 296 297 319 344 329 627 328 310 352 313 312 444 502 510 559 1142 508 561 444 410 366 234 217 223 237 269 221 261 239 472
Blob Type 1 compatibility with VarChar
2
bugs core 0856 
 tracker
 SS 2022.02.02 14:46 373 373 365 7 4 19 5 8 6 6 5 9 12 7 12 9 9 12 11 13 7 9 10 7 11 7 9 8 7 6
Unable to set FName, MName, LName fields in security to blank
3
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 514 526 530 5 18 7 17 6 7 6 5 10 12 8 8 9 10 9 8 8 8 6 6 5 7 15 6 14 13 6
ISQL crash when converted-from-double string longer than 23 bytes
4
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 367 352 373 7 12 24 7 6 6 5 7 15 9 11 13 12 13 13 6 8 7 6 6 9 6 10 5 5 7 6
ISQL crash when converted-from-double string longer than 23 bytes
5
bugs core 2216 
 tracker
 CS 2022.02.02 14:46 685 631 648 5 5 11 9 5 5 7 6 11 7 8 8 7 10 9 7 5 6 6 12 4 6 10 14 12 7 6
Nbackup as online dump
6
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 446 426 495 6 6 25 6 8 7 6 7 10 10 9 10 14 14 9 8 8 7 8 6 5 7 8 6 5 9 6
Nbackup as online dump
7
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 491 482 443 6 6 10 6 6 5 5 6 6 15 7 9 13 12 17 7 8 7 10 8 10 9 6 8 7 9 5
ASCII_VAL raises error instead of return 0 for empty strings
8
bugs core 3973 
 tracker
 SS 2023.12.11 15:18 1737 1681 719 1695 1703 820 1721 1736 1650 1740 588 986 1964 1173 962 1764 875 1096 747 704 773 686 1623 590 1673 546 647 592 741 812
Original table name and column name and owner missing from SQLDA for aliased column in grouped query
9
bugs core 5463 
 tracker
 SS 2023.07.18 08:54 509 523 531 5 5 29 5 8 8 6 6 8 13 14 10 8 11 12 8 6 7 7 7 5 9 6 9 5 6 6
Support GENERATED ALWAYS identity columns and OVERRIDE clause
10
bugs core 6219 
 tracker
 SS 2022.02.02 14:46 268 229 217 270 272 303 260 227 288 267 330 428 459 456 492 466 479 493 296 360 354 180 198 178 189 171 197 195 205 299
Add support for special (inf/nan) values when sorting DECFLOAT values
11
bugs gh 8211 
 tracker
 SS 2024.08.11 06:18 14952 14517 14723 15344 14885 17409 15765 15080 16076 16308 15168 22929 22885 862 475 906 624 601 2379 X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
12
functional intfunc string left 01 
 CS 2022.02.04 18:05 4041 3955 3901 5 8 11 22 6 5 7 5 11 12 11 11 10 8 12 9 9 10 7 5 9 9 6 6 6 6 6
LEFT function
13
functional intfunc string left 01 
 SS 2022.02.04 18:05 3822 3845 3859 5 8 4 5 6 6 7 5 8 13 11 41 11 12 9 8 6 6 7 5 6 7 8 4 5 5 4
LEFT function
14
functional intfunc string right 01 
 CS 2022.02.04 18:05 4013 4080 3925 6 12 6 16 6 6 6 9 7 10 13 13 9 14 9 5 11 9 9 9 7 7 7 7 7 10 12
RIGHT( <string>, <number> )
15
functional intfunc string right 01 
 SS 2022.02.04 18:05 3861 3727 3756 6 8 6 5 7 7 5 7 11 11 11 19 11 10 9 7 8 8 5 7 5 10 10 5 5 11 6
RIGHT( <string>, <number> )
16
functional intfunc string trunc 01 
 CS 2023.03.10 09:39 3546 3614 3470 3631 3625 3776 4730 3628 3750 3476 3672 4238 4315 854 906 839 1044 916 664 655 687 443 477 420 421 458 424 431 424 683
Test for TRUNC function
17
functional intfunc string trunc 01 
 SS 2023.03.10 09:39 3186 3151 3050 3200 3125 3042 3221 3156 3023 3234 3218 3425 3461 592 454 845 781 728 483 497 477 298 305 310 319 299 317 296 304 391
Test for TRUNC function

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1363
http://tracker.firebirdsql.org/browse/core-2216
http://tracker.firebirdsql.org/browse/core-3479
http://tracker.firebirdsql.org/browse/core-3973
http://tracker.firebirdsql.org/browse/core-5463
http://tracker.firebirdsql.org/browse/core-6219
http://tracker.firebirdsql.org/browse/core-655
http://tracker.firebirdsql.org/browse/core-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_trunc_01.py
https://github.com/FirebirdSQL/firebird/issues/8211
=== end of list ===

Last commits information (all timestamps in UTC):