01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (31 rows)
07. Has fails: tests with at least one fail for previous 30 runs (16 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2445 rows)
12. Skipped: tests which was intentionally excluded from execution (64 rows)

Generated UTC 10.11.2024 06:07
Tested: FB40.   Build/date: 4.0.6.3168 2024.11.07; latest GH: f67e22f8;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
14c68
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
Test TITLE
1
bugs core 1112 
 tracker
 SS 2022.02.02 14:46
298 298 298 296 296 296 296 298 302 298 296 296 294 294 296 330 330 330 217 217 215 217 215 215 215 213
Crash when dealing with a string literal longer than 32K
2
bugs core 1263 
 tracker
 CS 2022.02.02 14:46
440 444 444 449 450 450 450 450 450 451 451 453 451 451 495 507 495 495 330 326 321 314 313 313 321 312
GSec incorrectly processes some switches
3
bugs core 1292 
 tracker
 SS 2024.08.23 12:01
777 797 797 790 784 790 784 784 786 793 786 786 780 774 578 568 565 565 455 448 446 446 446 446 449 449
Can't create table using long username and UTF8 as attachment charset
4
bugs core 1506 
 tracker
 SS 2022.02.02 14:46
296 296 294 294 294 295 296 297 302 304 304 301 301 301 301 333 333 333 217 216 216 217 216 213 213 212
Server crash with isc_dsql_execute_immediate and zero length string
5
bugs core 1926 
 tracker
 SS 2022.02.02 14:46
321 321 321 321 320 320 320 320 330 330 330 325 319 319 319 354 354 354 239 236 236 236 236 235 234 234
MON$DATABASE returns outdated transaction counters
6
bugs core 3231 
 tracker
 SS 2022.02.02 14:46
317 310 304 301 295 295 299 300 300 300 300 300 300 300 300 331 331 331 218 212 212 218 212 218 218 212
OVERLAY() fails when used with text BLOBs containing multi-byte chars
7
bugs core 4058 
 tracker
 CS 2022.02.02 14:46
469 467 469 472 473 473 473 472 472 472 472 473 478 478 509 530 530 530 347 347 346 344 344 344 344 344
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
8
bugs core 4058 
 tracker
 SS 2022.02.02 14:46
258 258 250 262 250 250 251 251 251 251 251 250 252 252 252 290 290 290 171 168 168 169 168 169 169 165
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
9
bugs core 4439 
 tracker
 CS 2022.05.28 14:15
412 412 410 410 410 410 405 423 423 427 427 427 416 416 416 462 462 462 295 287 287 287 282 282 282 282
Raise the 1024 connections limit (FD_SETSIZE) on Windows SS/SC
10
bugs core 4461 
 tracker
 SS 2022.02.02 14:46
296 299 300 300 302 302 301 301 301 301 299 301 301 301 304 314 314 314 221 219 211 205 203 203 205 203
nbackup prints error messages to stdout instead stderr
11
bugs core 5434 
 tracker
 SS 2023.01.17 08:39
327 324 322 324 324 324 324 326 326 326 334 334 326 326 334 365 365 365 240 240 240 240 240 237 236 235
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
12
bugs core 5783 
 tracker
 SS 2022.02.02 14:46
304 304 297 298 298 297 296 295 295 295 296 297 299 299 302 333 333 333 215 215 215 215 212 215 215 215
execute statement ignores the text of the SQL-query after a comment of the form "-"
13
bugs core 5793 
 tracker
 SS 2023.03.07 10:42
304 302 302 302 298 297 297 294 298 297 299 299 299 299 302 328 328 328 218 210 210 210 212 212 215 215
Error returned from DbCryptPlugin::setKey() is not shown
14
bugs core 5908 
 tracker
 SS 2022.02.02 14:46
302 300 297 297 297 297 297 297 297 298 302 298 302 302 305 339 339 339 218 215 215 218 218 218 218 215
Enhance dynamic libraries loading related error messages
15
bugs core 5939 
 tracker
 CS 2022.02.02 14:46
418 418 423 424 424 424 431 424 431 427 427 420 420 420 420 470 470 470 303 296 296 296 295 295 294 294
Crash for "gbak -se -b database nul"
16
bugs core 5939 
 tracker
 SS 2022.02.02 14:46
247 243 243 243 243 243 247 247 259 246 259 246 250 250 268 287 287 287 167 164 163 163 163 163 163 160
Crash for "gbak -se -b database nul"
17
bugs core 5995 
 tracker
 SS 2024.05.15 17:26
3269 3265 3265 3267 3267 3267 3267 3268 3268 3266 3266 3271 3266 3258 3266 3289 3266 2444 2444 2435 2229 2229 2220 2219 2219 2219
Creator user name is empty in user trace sessions
18
bugs core 6003 
 tracker
 SS 2022.02.02 14:46
319 316 316 317 317 317 317 320 320 320 320 320 321 321 321 352 352 352 236 236 236 234 234 234 233 231
RDB$GET_TRANSACTION_CN works different in Super and Classic
19
bugs core 6227 
 tracker
 CS 2022.02.02 14:46
467 467 475 475 467 469 467 467 469 469 468 468 466 466 468 530 530 530 349 343 343 343 340 342 342 342
isc_info_svc_user_dbpath always returns alias of main security database
20
bugs core 6227 
 tracker
 SS 2022.02.02 14:46
249 249 245 246 246 250 247 250 250 252 252 252 252 252 253 288 288 288 168 167 167 168 168 165 170 165
isc_info_svc_user_dbpath always returns alias of main security database
21
bugs gh 6954 
 tracker
 SS 2024.07.21 16:25
269 269 274 278 271 271 271 270 270 270 276 276 276 276 278 309 309 309 190 186 186 X X X X X
Add fb_info_protocol_version information request to Attachment::getInfo().
22
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09
5156 5156 5170 5191 5195 5191 5191 5166 5166 5156 5166 5166 5155 5109 2794 2794 2769 2747 2726 2650 2592 2536 2536 2535 2535 2529
Improve performance of CURRENT_TIME
23
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09
4887 4881 4881 4887 4929 4943 4943 4929 4943 4943 4884 4883 4883 4878 2464 2464 2438 2438 2374 2356 2328 2328 2316 2316 2312 2305
Improve performance of CURRENT_TIME
24
bugs gh 7484 
 tracker
 SS 2023.03.02 16:01
322 322 324 324 320 320 320 320 325 325 325 324 321 321 324 350 350 350 237 235 235 235 235 235 235 231
External engine SYSTEM not found
25
bugs gh 7818 
 tracker
 SS 2024.05.09 13:58
295 299 299 302 301 301 301 301 301 301 301 301 301 301 309 333 333 333 219 217 217 218 217 217 218 213
Extend rdb$get_context('SYSTEM', '***') with client-related info
26
functional database alter 01 
 SS 2022.02.04 18:05
301 304 304 304 304 301 301 309 311 311 311 308 305 305 308 337 337 337 222 221 219 219 222 216 219 219
Alter database: adding a secondary file
27
functional database alter 02 
 SS 2022.02.04 18:05
306 306 306 301 300 300 301 303 305 305 304 304 304 304 305 330 330 330 218 218 217 217 215 215 212 212
Alter database: adding secondary file with alternate keyword
28
functional database alter 03 
 SS 2022.04.08 13:03
303 303 303 303 302 302 303 305 305 305 303 300 297 297 297 330 330 330 220 220 219 219 219 219 215 213
Alter database: add file with name of this database or previously added files must fail
29
functional intfunc list 03 
 SS 2022.02.04 18:05
294 294 297 297 297 297 297 297 304 304 304 295 295 295 297 339 339 339 220 220 220 220 220 223 222 219
List function with distinct option
30
functional intfunc string ascii val 01 
 SS 2022.02.04 18:05
299 297 299 299 299 302 302 301 302 301 301 304 304 304 308 338 338 338 221 219 218 218 218 218 218 218
ASCII_VAL( <string> )
31
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47
238 238 242 244 242 242 242 237 237 237 237 239 239 239 248 269 269 269 160 156 156 157 157 172 193 193
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
14c68
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
4.0.5.3123
2024.07.09
070ee
4.0.5.3123
2024.06.24
c27c6
4.0.5.3112
2024.06.13
d2e61
4.0.5.3109
2024.06.12
de9c0
Test TITLE
1
bugs core 1112 
 tracker
 SS 2022.02.02 14:46 307 290 298 352 298 294 295 296 533 298 296 302 307 292 294 296 289 330 340 339 209 217 213 225 215 219 210 213 217 156
Crash when dealing with a string literal longer than 32K
2
bugs core 1263 
 tracker
 CS 2022.02.02 14:46 440 434 437 444 454 449 442 465 450 450 444 453 466 451 446 512 444 495 507 516 326 314 330 313 321 297 312 331 343 297
GSec incorrectly processes some switches
3
bugs core 1292 
 tracker
 SS 2024.08.23 12:01 777 770 807 838 775 797 790 775 784 793 782 786 800 815 780 774 532 565 578 568 455 448 446 446 445 438 459 451 449 344
Can't create table using long username and UTF8 as attachment charset
4
bugs core 1506 
 tracker
 SS 2022.02.02 14:46 293 307 296 336 294 288 290 295 296 302 308 297 304 310 290 301 293 333 335 335 209 217 216 211 220 219 206 213 212 156
Server crash with isc_dsql_execute_immediate and zero length string
5
bugs core 1926 
 tracker
 SS 2022.02.02 14:46 336 318 320 347 321 323 316 320 320 315 334 330 338 325 319 312 319 356 354 365 230 236 239 236 226 234 258 235 224 172
MON$DATABASE returns outdated transaction counters
6
bugs core 3231 
 tracker
 SS 2022.02.02 14:46 324 326 310 304 317 293 295 301 293 299 300 315 320 300 300 293 291 331 332 378 207 218 212 211 257 218 212 227 210 156
OVERLAY() fails when used with text BLOBs containing multi-byte chars
7
bugs core 4058 
 tracker
 CS 2022.02.02 14:46 469 467 469 472 466 466 497 473 479 467 472 466 893 473 467 509 478 530 535 542 347 344 343 348 346 344 341 342 357 359
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
8
bugs core 4058 
 tracker
 SS 2022.02.02 14:46 244 258 250 264 274 245 250 262 246 251 251 244 255 276 250 249 252 290 291 313 168 171 168 167 169 171 164 169 165 125
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
9
bugs core 4439 
 tracker
 CS 2022.05.28 14:15 402 412 428 417 410 410 405 433 401 423 400 435 427 428 406 405 416 462 507 470 286 295 282 287 290 281 281 282 282 297
Raise the 1024 connections limit (FD_SETSIZE) on Windows SS/SC
10
bugs core 4461 
 tracker
 SS 2022.02.02 14:46 296 287 311 299 284 309 300 303 302 301 283 287 301 301 299 304 278 314 327 320 221 211 219 202 205 203 203 207 205 172
nbackup prints error messages to stdout instead stderr
11
bugs core 5434 
 tracker
 SS 2023.01.17 08:39 327 328 320 329 324 319 322 332 324 326 318 344 341 321 334 326 322 365 370 369 237 239 240 251 244 235 237 236 235 172
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
12
bugs core 5783 
 tracker
 SS 2022.02.02 14:46 320 304 294 309 304 297 296 298 307 295 290 295 307 297 296 299 302 333 338 338 215 215 211 240 212 219 205 215 219 157
execute statement ignores the text of the SQL-query after a comment of the form "-"
13
bugs core 5793 
 tracker
 SS 2023.03.07 10:42 307 301 299 304 305 302 297 294 298 292 300 288 312 297 299 302 296 328 332 334 210 209 218 210 210 218 212 216 215 141
Error returned from DbCryptPlugin::setKey() is not shown
14
bugs core 5908 
 tracker
 SS 2022.02.02 14:46 302 300 304 310 294 297 294 298 297 289 306 297 312 298 302 294 305 339 340 340 212 214 218 215 222 218 215 222 214 157
Enhance dynamic libraries loading related error messages
15
bugs core 5939 
 tracker
 CS 2022.02.02 14:46 416 414 423 460 418 418 442 424 438 417 431 419 445 427 420 419 417 470 488 491 296 303 295 296 297 281 294 295 292 297
Crash for "gbak -se -b database nul"
16
bugs core 5939 
 tracker
 SS 2022.02.02 14:46 251 247 242 254 240 243 243 247 279 241 267 246 259 244 268 244 250 287 294 301 160 167 160 164 163 156 163 165 160 109
Crash for "gbak -se -b database nul"
17
bugs core 5995 
 tracker
 SS 2024.05.15 17:26 3269 3272 2276 3273 3265 3261 3267 3281 3268 3266 3266 3272 3271 2304 3258 3289 3266 2312 3308 3313 2204 2444 2220 2435 2229 2211 2203 2219 2444 2375
Creator user name is empty in user trace sessions
18
bugs core 6003 
 tracker
 SS 2022.02.02 14:46 319 321 311 334 312 316 317 343 320 316 312 320 330 338 314 313 321 357 352 359 236 236 230 234 245 234 226 231 233 172
RDB$GET_TRANSACTION_CN works different in Super and Classic
19
bugs core 6227 
 tracker
 CS 2022.02.02 14:46 469 461 467 494 465 484 475 467 466 469 467 473 476 466 468 465 465 530 534 573 343 349 340 343 375 328 339 342 343 359
isc_info_svc_user_dbpath always returns alias of main security database
20
bugs core 6227 
 tracker
 SS 2022.02.02 14:46 253 249 244 261 245 258 243 246 250 255 247 250 261 252 253 245 245 292 293 288 167 163 168 161 181 171 165 161 170 125
isc_info_svc_user_dbpath always returns alias of main security database
21
bugs gh 6954 
 tracker
 SS 2024.07.21 16:25 269 267 274 278 267 269 294 281 271 265 268 270 280 276 276 278 264 313 310 309 186 190 185 186 194 X X X X X
Add fb_info_protocol_version information request to Attachment::getInfo().
22
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09 5198 5156 5148 5137 5207 5170 5249 5191 5195 5156 5152 5166 5312 5155 5193 5109 2794 2747 2769 3172 2592 2726 2650 2536 2535 2485 2749 2529 2650 2312
Improve performance of CURRENT_TIME
23
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09 4941 4955 4881 4887 4844 4870 4959 4929 5108 4943 4884 4869 5048 5207 4883 4878 2409 2464 2438 2580 2310 2374 2356 2316 2328 2282 2305 2318 2312 2079
Improve performance of CURRENT_TIME
24
bugs gh 7484 
 tracker
 SS 2023.03.02 16:01 320 321 322 330 324 319 330 320 312 320 329 325 325 321 324 316 319 350 358 355 232 237 235 234 245 235 231 243 229 187
External engine SYSTEM not found
25
bugs gh 7818 
 tracker
 SS 2024.05.09 13:58 294 299 295 303 293 303 299 302 301 295 301 301 312 300 309 301 295 333 342 340 216 219 216 217 225 218 210 213 230 156
Extend rdb$get_context('SYSTEM', '***') with client-related info
26
functional database alter 01 
 SS 2022.02.04 18:05 301 298 297 304 317 304 301 301 309 301 311 311 313 299 308 305 301 337 364 345 221 219 222 215 216 234 243 214 219 156
Alter database: adding a secondary file
27
functional database alter 02 
 SS 2022.02.04 18:05 299 296 306 312 393 298 301 300 299 321 315 303 305 304 301 305 295 330 344 338 215 218 218 217 215 203 212 225 212 141
Alter database: adding secondary file with alternate keyword
28
functional database alter 03 
 SS 2022.04.08 13:03 294 296 304 309 303 299 298 308 302 310 303 305 316 300 297 294 290 330 355 344 220 212 219 225 219 219 211 213 215 156
Alter database: add file with name of this database or previously added files must fail
29
functional intfunc list 03 
 SS 2022.02.04 18:05 296 289 291 311 294 299 297 297 293 295 304 305 308 295 294 289 297 339 340 344 217 220 220 224 225 219 214 223 222 157
List function with distinct option
30
functional intfunc string ascii val 01 
 SS 2022.02.04 18:05 311 295 297 305 299 296 302 297 302 335 301 294 308 299 308 304 300 339 341 338 219 212 221 217 218 218 213 221 219 157
ASCII_VAL( <string> )
31
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47 238 238 235 246 236 257 242 244 231 242 237 237 246 233 239 248 231 269 293 301 153 160 156 154 157 172 193 202 1594 156
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1112
http://tracker.firebirdsql.org/browse/core-1263
http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-1506
http://tracker.firebirdsql.org/browse/core-1926
http://tracker.firebirdsql.org/browse/core-3231
http://tracker.firebirdsql.org/browse/core-4058
http://tracker.firebirdsql.org/browse/core-4439
http://tracker.firebirdsql.org/browse/core-4461
http://tracker.firebirdsql.org/browse/core-5434
http://tracker.firebirdsql.org/browse/core-5783
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5908
http://tracker.firebirdsql.org/browse/core-5939
http://tracker.firebirdsql.org/browse/core-5995
http://tracker.firebirdsql.org/browse/core-6003
http://tracker.firebirdsql.org/browse/core-6227
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/list/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_val_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/6954
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7484
https://github.com/FirebirdSQL/firebird/issues/7818
=== end of list ===

Last commits information (all timestamps in UTC):