01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (2 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (1 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (19 rows)
07. Has fails: tests with at least one fail for previous 30 runs (39 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (605 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (2 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2643 rows)
12. Skipped: tests which was intentionally excluded from execution (62 rows)

Generated UTC 30.03.2025 13:53
Tested: HQ30.   Build / date: 3.0.13.33803-ea22ac1d / 2025.03.25;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33803
2025.03.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
262 261 261 265 265 265 265 267 304 304 304 220 141 141 137 125 X X X X X X X X X X
CS server crash altering SP in 2 connect
2 SS 2023.12.11 11:27
343 343 331 330 330 330 331 345 355 391 391 391 188 188 188 187 X X X X X X X X X X
Parameters inside the CAST function are described as not nullable
3 SS 2022.02.02 14:46
343 333 333 331 331 333 336 336 379 392 392 392 204 203 203 203 X X X X X X X X X X
Aliases for the RETURNING clause
4 SS 2022.04.08 11:16
357 345 336 336 336 336 341 361 424 361 361 284 188 188 188 187 X X X X X X X X X X
Nested loop plan is chosen instead of the sort merge for joining independent streams using keys of different types
5 SS 2022.02.02 14:46
238 232 229 229 229 229 232 243 285 285 285 151 110 110 109 109 X X X X X X X X X X
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
6 SS 2022.02.02 14:46
348 348 333 333 340 340 340 342 375 375 375 305 203 203 203 203 X X X X X X X X X X
String truncation error while selecting from MON$ tables if some user-defined context variable exceeds 255 bytes in length
7 SS 2022.02.02 14:46
389 385 385 387 387 382 387 387 433 433 433 359 235 235 235 234 X X X X X X X X X X
gfix -online normal <db> (being issued in window #1) does not produce error when there is sysdba attachment in window #2
8 SS 2023.01.17 08:39
286 269 269 267 269 267 279 280 312 312 312 221 141 141 141 140 X X X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
9 SS 2022.02.02 14:46
340 333 329 329 329 329 331 341 371 371 371 312 203 203 203 203 X X X X X X X X X X
ISQL incorrectly pads UNICODE_FSS/UTF8 columns when they use a collation
10 SS 2022.02.02 14:46
260 256 253 253 253 249 249 280 285 285 285 197 125 125 125 125 X X X X X X X X X X
execute statement ignores the text of the SQL-query after a comment of the form "-"
11 SS 2023.03.07 10:42
253 253 252 253 252 252 257 268 282 282 282 199 125 X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
12 SS 2022.02.02 14:46
373 373 373 373 371 374 374 374 417 417 417 357 234 234 234 234 X X X X X X X X X X
An attempt to create global mapping with long (greater than SQL identifier length) FROM field fails
13 SS 2022.02.02 14:46
255 255 255 255 255 252 252 252 301 301 301 220 134 125 125 125 X X X X X X X X X X
Enhance dynamic libraries loading related error messages
14 SS 2024.10.31 10:17
351 348 348 348 348 347 349 350 401 401 401 332 219 219 219 219 X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
15 SS 2022.02.02 14:46
284 283 281 281 281 281 281 283 322 322 322 236 157 157 157 156 X X X X X X X X X X
Bugcheck could happen when read-only database with non-zero linger is set to read-write mode
16 SS 2023.05.24 17:29
332 332 331 331 331 332 336 341 380 380 380 285 187 187 187 187 X X X X X X X X X X
RELEASE SAVEPOINT ONLY works incorrectly
17 SS 2024.12.29 08:33
X X 253 267 255 255 269 269 297 297 297 205 126 125 125 125 X X X X X X X X X X
Alter database: adding a secondary file
18 SS 2023.10.06 13:04
X X 347 347 347 347 347 347 390 390 390 309 204 204 203 203 X X X X X X X X X X
CREATE DOMAIN using 'CHARACTER VARYING' keyword
19 SS 2023.10.09 08:11
X X 360 360 360 360 360 366 390 390 390 339 219 219 219 219 X X X X X X X X X X
CREATE DOMAIN. Check ability to declare using syntax BLOB(seglen, num_subtype)

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33803
2025.03.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 262 285 261 266 260 261 265 265 267 265 304 335 331 220 141 137 141 125 125 124 X X X X X X X X X X
CS server crash altering SP in 2 connect
2 SS 2023.12.11 11:27 332 344 343 755 314 330 331 315 345 314 355 391 420 647 188 188 187 188 187 187 X X X X X X X X X X
Parameters inside the CAST function are described as not nullable
3 SS 2022.02.02 14:46 343 345 350 328 330 333 343 331 331 336 379 406 410 392 203 203 204 203 203 202 X X X X X X X X X X
Aliases for the RETURNING clause
4 SS 2022.04.08 11:16 357 358 345 565 330 310 336 341 456 329 361 541 424 284 188 188 187 187 188 187 X X X X X X X X X X
Nested loop plan is chosen instead of the sort merge for joining independent streams using keys of different types
5 SS 2022.02.02 14:46 244 238 240 225 232 228 229 243 225 232 285 300 292 151 110 109 110 109 109 109 X X X X X X X X X X
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
6 SS 2022.02.02 14:46 349 348 332 333 348 350 327 332 340 342 375 395 397 305 203 203 203 203 188 187 X X X X X X X X X X
String truncation error while selecting from MON$ tables if some user-defined context variable exceeds 255 bytes in length
7 SS 2022.02.02 14:46 407 417 381 385 389 380 403 387 382 382 433 466 467 359 235 235 234 235 234 233 X X X X X X X X X X
gfix -online normal <db> (being issued in window #1) does not produce error when there is sysdba attachment in window #2
8 SS 2023.01.17 08:39 289 286 288 264 269 267 279 267 280 264 312 345 341 221 141 140 141 140 141 139 X X X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
9 SS 2022.02.02 14:46 347 346 329 340 333 328 329 328 341 331 371 407 432 312 203 203 203 204 204 203 X X X X X X X X X X
ISQL incorrectly pads UNICODE_FSS/UTF8 columns when they use a collation
10 SS 2022.02.02 14:46 276 260 263 244 253 256 247 280 249 249 285 342 319 197 125 125 125 125 125 124 X X X X X X X X X X
execute statement ignores the text of the SQL-query after a comment of the form "-"
11 SS 2023.03.07 10:42 280 261 248 253 253 252 252 268 249 257 282 360 325 199 125 125 114 X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
12 SS 2022.02.02 14:46 393 385 369 373 368 380 382 371 371 374 417 448 443 357 234 234 219 235 235 233 X X X X X X X X X X
An attempt to create global mapping with long (greater than SQL identifier length) FROM field fails
13 SS 2022.02.02 14:46 266 275 255 250 255 255 256 251 250 252 301 326 324 220 125 125 134 125 125 124 X X X X X X X X X X
Enhance dynamic libraries loading related error messages
14 SS 2024.10.31 10:17 370 380 351 347 348 343 349 350 345 347 401 419 431 332 219 219 211 219 219 218 X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
15 SS 2022.02.02 14:46 297 301 280 283 284 281 279 281 283 278 322 363 365 236 157 157 157 156 156 156 X X X X X X X X X X
Bugcheck could happen when read-only database with non-zero linger is set to read-write mode
16 SS 2023.05.24 17:29 331 347 332 353 328 331 328 341 332 336 380 431 404 285 187 187 187 188 188 186 X X X X X X X X X X
RELEASE SAVEPOINT ONLY works incorrectly
17 SS 2024.12.29 08:33 X X 250 267 252 253 506 269 255 253 297 350 355 205 125 125 126 125 125 124 X X X X X X X X X X
Alter database: adding a secondary file
18 SS 2023.10.06 13:04 X X 345 345 347 347 351 331 347 340 390 440 407 309 203 204 204 203 203 203 X X X X X X X X X X
CREATE DOMAIN using 'CHARACTER VARYING' keyword
19 SS 2023.10.09 08:11 X X 348 360 372 376 354 358 360 366 390 455 425 339 219 219 219 219 219 218 X X X X X X X X X X
CREATE DOMAIN. Check ability to declare using syntax BLOB(seglen, num_subtype)

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-210
http://tracker.firebirdsql.org/browse/CORE-3475
http://tracker.firebirdsql.org/browse/CORE-3546
http://tracker.firebirdsql.org/browse/CORE-3553
http://tracker.firebirdsql.org/browse/CORE-4058
http://tracker.firebirdsql.org/browse/CORE-5246
http://tracker.firebirdsql.org/browse/CORE-5364
http://tracker.firebirdsql.org/browse/CORE-5434
http://tracker.firebirdsql.org/browse/CORE-5569
http://tracker.firebirdsql.org/browse/CORE-5783
http://tracker.firebirdsql.org/browse/CORE-5793
http://tracker.firebirdsql.org/browse/CORE-5904
http://tracker.firebirdsql.org/browse/CORE-5908
http://tracker.firebirdsql.org/browse/CORE-5926
http://tracker.firebirdsql.org/browse/CORE-5949
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_17.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_31.py
https://github.com/FirebirdSQL/firebird/issues/7591
=== end of list ===

Last commits information (all timestamps in UTC):