01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (3 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (32 rows)
07. Has fails: tests with at least one fail for previous 30 runs (14 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2444 rows)
12. Skipped: tests which was intentionally excluded from execution (64 rows)

Generated UTC 21.11.2024 06:10
Tested: FB40.   Build / date: 4.0.6.3168-f67e22f8 / 2024.11.07;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
14c68
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
Test TITLE
1
bugs core 1112 
 tracker
 SS 2022.02.02 14:46
298 298 298 296 296 296 296 298 302 298 296 296 294 294 296 330 330 330 217 217 215 217 215 215 215 213
Crash when dealing with a string literal longer than 32K
2
bugs core 1263 
 tracker
 CS 2022.02.02 14:46
442 444 444 449 450 450 450 450 450 451 451 453 451 451 495 507 495 495 330 326 321 314 313 313 321 312
GSec incorrectly processes some switches
3
bugs core 1292 
 tracker
 SS 2024.08.23 12:01
791 797 797 790 784 790 784 784 786 793 786 786 780 774 578 568 565 565 455 448 446 446 446 446 449 449
Can't create table using long username and UTF8 as attachment charset
4
bugs core 1315 
 tracker
 SS 2022.02.02 14:46
294 294 294 294 294 296 294 299 305 305 299 299 299 299 299 333 333 333 221 220 210 210 209 210 210 209
Data type unknown
5
bugs core 1506 
 tracker
 SS 2022.02.02 14:46
296 296 294 294 294 295 296 297 302 304 304 301 301 301 301 333 333 333 217 216 216 217 216 213 213 212
Server crash with isc_dsql_execute_immediate and zero length string
6
bugs core 1926 
 tracker
 SS 2022.02.02 14:46
320 321 321 321 320 320 320 320 330 330 330 325 319 319 319 354 354 354 239 236 236 236 236 235 234 234
MON$DATABASE returns outdated transaction counters
7
bugs core 3231 
 tracker
 SS 2022.02.02 14:46
310 310 304 301 295 295 299 300 300 300 300 300 300 300 300 331 331 331 218 212 212 218 212 218 218 212
OVERLAY() fails when used with text BLOBs containing multi-byte chars
8
bugs core 3779 
 tracker
 CS 2022.02.02 14:46
501 502 502 502 502 503 502 502 504 505 502 502 499 499 499 553 553 553 375 375 375 375 376 376 376 376
Report OS user name in MON$ATTACHMENTS
9
bugs core 4058 
 tracker
 CS 2022.02.02 14:46
467 467 469 472 473 473 473 472 472 472 472 473 478 478 509 530 530 530 347 347 346 344 344 344 344 344
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
10
bugs core 4058 
 tracker
 SS 2022.02.02 14:46
258 258 250 262 250 250 251 251 251 251 251 250 252 252 252 290 290 290 171 168 168 169 168 169 169 165
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
11
bugs core 4439 
 tracker
 CS 2022.05.28 14:15
417 412 410 410 410 410 405 423 423 427 427 427 416 416 416 462 462 462 295 287 287 287 282 282 282 282
Raise the 1024 connections limit (FD_SETSIZE) on Windows SS/SC
12
bugs core 5434 
 tracker
 SS 2023.01.17 08:39
324 324 322 324 324 324 324 326 326 326 334 334 326 326 334 365 365 365 240 240 240 240 240 237 236 235
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
13
bugs core 5783 
 tracker
 SS 2022.02.02 14:46
304 304 297 298 298 297 296 295 295 295 296 297 299 299 302 333 333 333 215 215 215 215 212 215 215 215
execute statement ignores the text of the SQL-query after a comment of the form "-"
14
bugs core 5793 
 tracker
 SS 2023.03.07 10:42
304 302 302 302 298 297 297 294 298 297 299 299 299 299 302 328 328 328 218 210 210 210 212 212 215 215
Error returned from DbCryptPlugin::setKey() is not shown
15
bugs core 5908 
 tracker
 SS 2022.02.02 14:46
304 300 297 297 297 297 297 297 297 298 302 298 302 302 305 339 339 339 218 215 215 218 218 218 218 215
Enhance dynamic libraries loading related error messages
16
bugs core 5939 
 tracker
 CS 2022.02.02 14:46
418 418 423 424 424 424 431 424 431 427 427 420 420 420 420 470 470 470 303 296 296 296 295 295 294 294
Crash for "gbak -se -b database nul"
17
bugs core 5939 
 tracker
 SS 2022.02.02 14:46
246 243 243 243 243 243 247 247 259 246 259 246 250 250 268 287 287 287 167 164 163 163 163 163 163 160
Crash for "gbak -se -b database nul"
18
bugs core 5995 
 tracker
 SS 2024.05.15 17:26
3272 3265 3265 3267 3267 3267 3267 3268 3268 3266 3266 3271 3266 3258 3266 3289 3266 2444 2444 2435 2229 2229 2220 2219 2219 2219
Creator user name is empty in user trace sessions
19
bugs core 6003 
 tracker
 SS 2022.02.02 14:46
321 316 316 317 317 317 317 320 320 320 320 320 321 321 321 352 352 352 236 236 236 234 234 234 233 231
RDB$GET_TRANSACTION_CN works different in Super and Classic
20
bugs core 6227 
 tracker
 CS 2022.02.02 14:46
467 467 475 475 467 469 467 467 469 469 468 468 466 466 468 530 530 530 349 343 343 343 340 342 342 342
isc_info_svc_user_dbpath always returns alias of main security database
21
bugs core 6227 
 tracker
 SS 2022.02.02 14:46
247 249 245 246 246 250 247 250 250 252 252 252 252 252 253 288 288 288 168 167 167 168 168 165 170 165
isc_info_svc_user_dbpath always returns alias of main security database
22
bugs gh 6954 
 tracker
 SS 2024.07.21 16:25
270 269 274 278 271 271 271 270 270 270 276 276 276 276 278 309 309 309 190 186 186 X X X X X
Add fb_info_protocol_version information request to Attachment::getInfo().
23
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09
5156 5156 5170 5191 5195 5191 5191 5166 5166 5156 5166 5166 5155 5109 2794 2794 2769 2747 2726 2650 2592 2536 2536 2535 2535 2529
Improve performance of CURRENT_TIME
24
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09
4887 4881 4881 4887 4929 4943 4943 4929 4943 4943 4884 4883 4883 4878 2464 2464 2438 2438 2374 2356 2328 2328 2316 2316 2312 2305
Improve performance of CURRENT_TIME
25
bugs gh 7484 
 tracker
 SS 2023.03.02 16:01
324 322 324 324 320 320 320 320 325 325 325 324 321 321 324 350 350 350 237 235 235 235 235 235 235 231
External engine SYSTEM not found
26
bugs gh 7818 
 tracker
 SS 2024.05.09 13:58
299 299 299 302 301 301 301 301 301 301 301 301 301 301 309 333 333 333 219 217 217 218 217 217 218 213
Extend rdb$get_context('SYSTEM', '***') with client-related info
27
functional database alter 01 
 SS 2022.02.04 18:05
298 304 304 304 304 301 301 309 311 311 311 308 305 305 308 337 337 337 222 221 219 219 222 216 219 219
Alter database: adding a secondary file
28
functional database alter 02 
 SS 2022.02.04 18:05
306 306 306 301 300 300 301 303 305 305 304 304 304 304 305 330 330 330 218 218 217 217 215 215 212 212
Alter database: adding secondary file with alternate keyword
29
functional database alter 03 
 SS 2022.04.08 13:03
303 303 303 303 302 302 303 305 305 305 303 300 297 297 297 330 330 330 220 220 219 219 219 219 215 213
Alter database: add file with name of this database or previously added files must fail
30
functional intfunc list 03 
 SS 2022.02.04 18:05
294 294 297 297 297 297 297 297 304 304 304 295 295 295 297 339 339 339 220 220 220 220 220 223 222 219
List function with distinct option
31
functional intfunc string ascii val 01 
 SS 2022.02.04 18:05
299 297 299 299 299 302 302 301 302 301 301 304 304 304 308 338 338 338 221 219 218 218 218 218 218 218
ASCII_VAL( <string> )
32
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47
236 238 242 244 242 242 242 237 237 237 237 239 239 239 248 269 269 269 160 156 156 157 157 172 193 193
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode Test last update
4.0.6.3168
2024.11.07
f67e2
4.0.6.3167
2024.11.04
c9228
4.0.6.3165
2024.10.23
b0c36
4.0.6.3164
2024.10.17
35344
4.0.6.3161
2024.10.05
91502
4.0.6.3159
2024.10.01
85136
4.0.6.3158
2024.09.30
14c68
4.0.6.3157
2024.09.24
3bb2e
4.0.6.3156
2024.09.21
f6416
4.0.6.3155
2024.09.20
1ed0c
4.0.6.3151
2024.09.09
1b77f
4.0.6.3149
2024.09.04
32ce9
4.0.6.3148
2024.09.02
4be5c
4.0.6.3147
2024.08.30
5ffd7
4.0.6.3146
2024.08.27
38582
4.0.6.3145
2024.08.21
87240
4.0.6.3144
2024.08.20
5a3b7
4.0.6.3142
2024.08.11
b9f39
4.0.6.3141
2024.08.09
6d39f
4.0.5.3140
2024.08.06
64f3a
4.0.5.3139
2024.08.01
3bc8b
4.0.5.3136
2024.07.31
e41ec
4.0.5.3135
2024.07.26
b4981
4.0.5.3129
2024.07.24
b8184
4.0.5.3128
2024.07.13
aa318
4.0.5.3127
2024.07.10
eace3
4.0.5.3123
2024.07.09
070ee
4.0.5.3123
2024.06.24
c27c6
4.0.5.3112
2024.06.13
d2e61
4.0.5.3109
2024.06.12
de9c0
Test TITLE
1
bugs core 1112 
 tracker
 SS 2022.02.02 14:46 296 290 298 352 298 294 295 296 533 298 296 302 307 292 294 296 289 330 340 339 209 217 213 225 215 219 210 213 217 156
Crash when dealing with a string literal longer than 32K
2
bugs core 1263 
 tracker
 CS 2022.02.02 14:46 442 434 437 444 454 449 442 465 450 450 444 453 466 451 446 512 444 495 507 516 326 314 330 313 321 297 312 331 343 297
GSec incorrectly processes some switches
3
bugs core 1292 
 tracker
 SS 2024.08.23 12:01 791 770 807 838 775 797 790 775 784 793 782 786 800 815 780 774 532 565 578 568 455 448 446 446 445 438 459 451 449 344
Can't create table using long username and UTF8 as attachment charset
4
bugs core 1315 
 tracker
 SS 2022.02.02 14:46 305 292 292 328 294 296 294 294 306 310 293 299 305 305 294 299 296 333 334 340 221 220 209 208 210 219 208 212 209 156
Data type unknown
5
bugs core 1506 
 tracker
 SS 2022.02.02 14:46 291 307 296 336 294 288 290 295 296 302 308 297 304 310 290 301 293 333 335 335 209 217 216 211 220 219 206 213 212 156
Server crash with isc_dsql_execute_immediate and zero length string
6
bugs core 1926 
 tracker
 SS 2022.02.02 14:46 314 318 320 347 321 323 316 320 320 315 334 330 338 325 319 312 319 356 354 365 230 236 239 236 226 234 258 235 224 172
MON$DATABASE returns outdated transaction counters
7
bugs core 3231 
 tracker
 SS 2022.02.02 14:46 303 326 310 304 317 293 295 301 293 299 300 315 320 300 300 293 291 331 332 378 207 218 212 211 257 218 212 227 210 156
OVERLAY() fails when used with text BLOBs containing multi-byte chars
8
bugs core 3779 
 tracker
 CS 2022.02.02 14:46 501 495 491 518 502 503 497 492 504 507 502 502 507 505 495 499 494 553 565 567 374 375 374 378 376 360 376 372 391 391
Report OS user name in MON$ATTACHMENTS
9
bugs core 4058 
 tracker
 CS 2022.02.02 14:46 466 467 469 472 466 466 497 473 479 467 472 466 893 473 467 509 478 530 535 542 347 344 343 348 346 344 341 342 357 359
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
10
bugs core 4058 
 tracker
 SS 2022.02.02 14:46 244 258 250 264 274 245 250 262 246 251 251 244 255 276 250 249 252 290 291 313 168 171 168 167 169 171 164 169 165 125
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
11
bugs core 4439 
 tracker
 CS 2022.05.28 14:15 436 412 428 417 410 410 405 433 401 423 400 435 427 428 406 405 416 462 507 470 286 295 282 287 290 281 281 282 282 297
Raise the 1024 connections limit (FD_SETSIZE) on Windows SS/SC
12
bugs core 5434 
 tracker
 SS 2023.01.17 08:39 321 328 320 329 324 319 322 332 324 326 318 344 341 321 334 326 322 365 370 369 237 239 240 251 244 235 237 236 235 172
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
13
bugs core 5783 
 tracker
 SS 2022.02.02 14:46 295 304 294 309 304 297 296 298 307 295 290 295 307 297 296 299 302 333 338 338 215 215 211 240 212 219 205 215 219 157
execute statement ignores the text of the SQL-query after a comment of the form "-"
14
bugs core 5793 
 tracker
 SS 2023.03.07 10:42 307 301 299 304 305 302 297 294 298 292 300 288 312 297 299 302 296 328 332 334 210 209 218 210 210 218 212 216 215 141
Error returned from DbCryptPlugin::setKey() is not shown
15
bugs core 5908 
 tracker
 SS 2022.02.02 14:46 304 300 304 310 294 297 294 298 297 289 306 297 312 298 302 294 305 339 340 340 212 214 218 215 222 218 215 222 214 157
Enhance dynamic libraries loading related error messages
16
bugs core 5939 
 tracker
 CS 2022.02.02 14:46 414 414 423 460 418 418 442 424 438 417 431 419 445 427 420 419 417 470 488 491 296 303 295 296 297 281 294 295 292 297
Crash for "gbak -se -b database nul"
17
bugs core 5939 
 tracker
 SS 2022.02.02 14:46 246 247 242 254 240 243 243 247 279 241 267 246 259 244 268 244 250 287 294 301 160 167 160 164 163 156 163 165 160 109
Crash for "gbak -se -b database nul"
18
bugs core 5995 
 tracker
 SS 2024.05.15 17:26 3405 3272 2276 3273 3265 3261 3267 3281 3268 3266 3266 3272 3271 2304 3258 3289 3266 2312 3308 3313 2204 2444 2220 2435 2229 2211 2203 2219 2444 2375
Creator user name is empty in user trace sessions
19
bugs core 6003 
 tracker
 SS 2022.02.02 14:46 321 321 311 334 312 316 317 343 320 316 312 320 330 338 314 313 321 357 352 359 236 236 230 234 245 234 226 231 233 172
RDB$GET_TRANSACTION_CN works different in Super and Classic
20
bugs core 6227 
 tracker
 CS 2022.02.02 14:46 468 461 467 494 465 484 475 467 466 469 467 473 476 466 468 465 465 530 534 573 343 349 340 343 375 328 339 342 343 359
isc_info_svc_user_dbpath always returns alias of main security database
21
bugs core 6227 
 tracker
 SS 2022.02.02 14:46 247 249 244 261 245 258 243 246 250 255 247 250 261 252 253 245 245 292 293 288 167 163 168 161 181 171 165 161 170 125
isc_info_svc_user_dbpath always returns alias of main security database
22
bugs gh 6954 
 tracker
 SS 2024.07.21 16:25 270 267 274 278 267 269 294 281 271 265 268 270 280 276 276 278 264 313 310 309 186 190 185 186 194 X X X X X
Add fb_info_protocol_version information request to Attachment::getInfo().
23
bugs gh 7092 
 tracker
 CS 2024.08.22 13:09 5190 5156 5148 5137 5207 5170 5249 5191 5195 5156 5152 5166 5312 5155 5193 5109 2794 2747 2769 3172 2592 2726 2650 2536 2535 2485 2749 2529 2650 2312
Improve performance of CURRENT_TIME
24
bugs gh 7092 
 tracker
 SS 2024.08.22 13:09 4900 4955 4881 4887 4844 4870 4959 4929 5108 4943 4884 4869 5048 5207 4883 4878 2409 2464 2438 2580 2310 2374 2356 2316 2328 2282 2305 2318 2312 2079
Improve performance of CURRENT_TIME
25
bugs gh 7484 
 tracker
 SS 2023.03.02 16:01 325 321 322 330 324 319 330 320 312 320 329 325 325 321 324 316 319 350 358 355 232 237 235 234 245 235 231 243 229 187
External engine SYSTEM not found
26
bugs gh 7818 
 tracker
 SS 2024.05.09 13:58 300 299 295 303 293 303 299 302 301 295 301 301 312 300 309 301 295 333 342 340 216 219 216 217 225 218 210 213 230 156
Extend rdb$get_context('SYSTEM', '***') with client-related info
27
functional database alter 01 
 SS 2022.02.04 18:05 296 298 297 304 317 304 301 301 309 301 311 311 313 299 308 305 301 337 364 345 221 219 222 215 216 234 243 214 219 156
Alter database: adding a secondary file
28
functional database alter 02 
 SS 2022.02.04 18:05 305 296 306 312 393 298 301 300 299 321 315 303 305 304 301 305 295 330 344 338 215 218 218 217 215 203 212 225 212 141
Alter database: adding secondary file with alternate keyword
29
functional database alter 03 
 SS 2022.04.08 13:03 300 296 304 309 303 299 298 308 302 310 303 305 316 300 297 294 290 330 355 344 220 212 219 225 219 219 211 213 215 156
Alter database: add file with name of this database or previously added files must fail
30
functional intfunc list 03 
 SS 2022.02.04 18:05 302 289 291 311 294 299 297 297 293 295 304 305 308 295 294 289 297 339 340 344 217 220 220 224 225 219 214 223 222 157
List function with distinct option
31
functional intfunc string ascii val 01 
 SS 2022.02.04 18:05 311 295 297 305 299 296 302 297 302 335 301 294 308 299 308 304 300 339 341 338 219 212 221 217 218 218 213 221 219 157
ASCII_VAL( <string> )
32
functional tabloid crash when too long username for auth 
 SS 2024.07.14 08:47 234 238 235 246 236 257 242 244 231 242 237 237 246 233 239 248 231 269 293 301 153 160 156 154 157 172 193 202 1594 156
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1112
http://tracker.firebirdsql.org/browse/core-1263
http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-1315
http://tracker.firebirdsql.org/browse/core-1506
http://tracker.firebirdsql.org/browse/core-1926
http://tracker.firebirdsql.org/browse/core-3231
http://tracker.firebirdsql.org/browse/core-3779
http://tracker.firebirdsql.org/browse/core-4058
http://tracker.firebirdsql.org/browse/core-4439
http://tracker.firebirdsql.org/browse/core-5434
http://tracker.firebirdsql.org/browse/core-5783
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5908
http://tracker.firebirdsql.org/browse/core-5939
http://tracker.firebirdsql.org/browse/core-5995
http://tracker.firebirdsql.org/browse/core-6003
http://tracker.firebirdsql.org/browse/core-6227
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/list/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_val_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/6954
https://github.com/FirebirdSQL/firebird/issues/7092
https://github.com/FirebirdSQL/firebird/issues/7484
https://github.com/FirebirdSQL/firebird/issues/7818
=== end of list ===

Last commits information (all timestamps in UTC):