01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (22 rows)
07. Has fails: tests with at least one fail for previous 30 runs (38 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2038 rows)
12. Skipped: tests which was intentionally excluded from execution (61 rows)

Generated UTC 14.02.2025 09:52
Tested: HQ30.   Build / date: 3.0.13.33796-0ab85166 / 2025.01.29;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
265 265 265 265 265 267 304 304 304 220 141 141 137 125 X X X X X X X X X X X X
CS server crash altering SP in 2 connect
2 SS 2022.02.02 14:46
718 718 718 457 457 457 484 484 484 407 313 312 312 312 X X X X X X X X X X X X
Error "data type unknown" while preparing UPDATE/DELETE statements with the parameterized ROWS clause
3 SS 2023.12.11 11:27
330 330 330 330 331 345 355 391 391 391 188 188 188 187 X X X X X X X X X X X X
Parameters inside the CAST function are described as not nullable
4 SS 2022.02.02 14:46
330 331 331 333 336 336 379 392 392 392 204 203 203 203 X X X X X X X X X X X X
Aliases for the RETURNING clause
5 SS 2022.04.08 11:16
330 336 336 336 341 361 424 361 361 284 188 188 188 187 X X X X X X X X X X X X
Nested loop plan is chosen instead of the sort merge for joining independent streams using keys of different types
6 SS 2022.02.02 14:46
229 229 229 229 232 243 285 285 285 151 110 110 109 109 X X X X X X X X X X X X
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
7 SS 2022.02.02 14:46
837 814 814 814 814 806 806 753 452 353 297 297 297 297 X X X X X X X X X X X X
internal Firebird consistency check (cannot find tip page (165), file: tra.cpp line: 2375)
8 SS 2022.02.02 14:46
737 737 737 471 521 521 521 521 521 394 313 313 313 313 X X X X X X X X X X X X
BLOB not found in SuperClassic and Classic on Uncommitted Transactions
9 SS 2022.02.02 14:46
338 333 340 340 340 342 375 375 375 305 203 203 203 203 X X X X X X X X X X X X
String truncation error while selecting from MON$ tables if some user-defined context variable exceeds 255 bytes in length
10 SS 2022.02.02 14:46
389 387 387 382 387 387 433 433 433 359 235 235 235 234 X X X X X X X X X X X X
gfix -online normal <db> (being issued in window #1) does not produce error when there is sysdba attachment in window #2
11 SS 2023.01.17 08:39
269 267 269 267 279 280 312 312 312 221 141 141 141 140 X X X X X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
12 SS 2022.02.02 14:46
331 329 329 329 331 341 371 371 371 312 203 203 203 203 X X X X X X X X X X X X
ISQL incorrectly pads UNICODE_FSS/UTF8 columns when they use a collation
13 SS 2022.02.02 14:46
250 253 253 249 249 280 285 285 285 197 125 125 125 125 X X X X X X X X X X X X
execute statement ignores the text of the SQL-query after a comment of the form "-"
14 SS 2023.03.07 10:42
253 253 252 252 257 268 282 282 282 199 125 X X X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
15 SS 2022.02.02 14:46
380 373 371 374 374 374 417 417 417 357 234 234 234 234 X X X X X X X X X X X X
An attempt to create global mapping with long (greater than SQL identifier length) FROM field fails
16 SS 2022.02.02 14:46
255 255 255 252 252 252 301 301 301 220 134 125 125 125 X X X X X X X X X X X X
Enhance dynamic libraries loading related error messages
17 SS 2024.10.31 10:17
348 348 348 347 349 350 401 401 401 332 219 219 219 219 X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
18 SS 2022.02.02 14:46
283 281 281 281 281 283 322 322 322 236 157 157 157 156 X X X X X X X X X X X X
Bugcheck could happen when read-only database with non-zero linger is set to read-write mode
19 SS 2023.05.24 17:29
331 331 331 332 336 341 380 380 380 285 187 187 187 187 X X X X X X X X X X X X
RELEASE SAVEPOINT ONLY works incorrectly
20 SS 2024.12.29 08:33
258 267 255 255 269 269 297 297 297 205 126 125 125 125 X X X X X X X X X X X X
Alter database: adding a secondary file
21 SS 2023.10.06 13:04
347 347 347 347 347 347 390 390 390 309 204 204 203 203 X X X X X X X X X X X X
CREATE DOMAIN using 'CHARACTER VARYING' keyword
22 SS 2023.10.09 08:11
360 360 360 360 360 366 390 390 390 339 219 219 219 219 X X X X X X X X X X X X
CREATE DOMAIN. Check ability to declare using syntax BLOB(seglen, num_subtype)

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 265 266 260 261 265 265 267 265 304 335 331 220 141 137 141 125 125 124 X X X X X X X X X X X X
CS server crash altering SP in 2 connect
2 SS 2022.02.02 14:46 442 468 719 718 747 457 457 441 484 534 723 407 312 313 312 312 313 312 X X X X X X X X X X X X
Error "data type unknown" while preparing UPDATE/DELETE statements with the parameterized ROWS clause
3 SS 2023.12.11 11:27 317 755 314 330 331 315 345 314 355 391 420 647 188 188 187 188 187 187 X X X X X X X X X X X X
Parameters inside the CAST function are described as not nullable
4 SS 2022.02.02 14:46 329 328 330 333 343 331 331 336 379 406 410 392 203 203 204 203 203 202 X X X X X X X X X X X X
Aliases for the RETURNING clause
5 SS 2022.04.08 11:16 328 565 330 310 336 341 456 329 361 541 424 284 188 188 187 187 188 187 X X X X X X X X X X X X
Nested loop plan is chosen instead of the sort merge for joining independent streams using keys of different types
6 SS 2022.02.02 14:46 229 225 232 228 229 243 225 232 285 300 292 151 110 109 110 109 109 109 X X X X X X X X X X X X
Remote Stack Buffer Overflow in Firebird SQL Server (when specially crafted packet is sent via socket API)
7 SS 2022.02.02 14:46 855 848 418 415 837 814 818 806 452 753 835 353 297 297 297 297 297 295 X X X X X X X X X X X X
internal Firebird consistency check (cannot find tip page (165), file: tra.cpp line: 2375)
8 SS 2022.02.02 14:46 753 442 772 462 737 744 471 471 521 758 610 394 296 313 313 313 313 311 X X X X X X X X X X X X
BLOB not found in SuperClassic and Classic on Uncommitted Transactions
9 SS 2022.02.02 14:46 338 333 348 350 327 332 340 342 375 395 397 305 203 203 203 203 188 187 X X X X X X X X X X X X
String truncation error while selecting from MON$ tables if some user-defined context variable exceeds 255 bytes in length
10 SS 2022.02.02 14:46 394 385 389 380 403 387 382 382 433 466 467 359 235 235 234 235 234 233 X X X X X X X X X X X X
gfix -online normal <db> (being issued in window #1) does not produce error when there is sysdba attachment in window #2
11 SS 2023.01.17 08:39 281 264 269 267 279 267 280 264 312 345 341 221 141 140 141 140 141 139 X X X X X X X X X X X X
Read-only transactions in SuperServer could avoid immediate write of Header and TIP pages after change
12 SS 2022.02.02 14:46 331 340 333 328 329 328 341 331 371 407 432 312 203 203 203 204 204 203 X X X X X X X X X X X X
ISQL incorrectly pads UNICODE_FSS/UTF8 columns when they use a collation
13 SS 2022.02.02 14:46 250 244 253 256 247 280 249 249 285 342 319 197 125 125 125 125 125 124 X X X X X X X X X X X X
execute statement ignores the text of the SQL-query after a comment of the form "-"
14 SS 2023.03.07 10:42 263 253 253 252 252 268 249 257 282 360 325 199 125 125 114 X X X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
15 SS 2022.02.02 14:46 380 373 368 380 382 371 371 374 417 448 443 357 234 234 219 235 235 233 X X X X X X X X X X X X
An attempt to create global mapping with long (greater than SQL identifier length) FROM field fails
16 SS 2022.02.02 14:46 259 250 255 255 256 251 250 252 301 326 324 220 125 125 134 125 125 124 X X X X X X X X X X X X
Enhance dynamic libraries loading related error messages
17 SS 2024.10.31 10:17 360 347 348 343 349 350 345 347 401 419 431 332 219 219 211 219 219 218 X X X X X X X X X X X X
Attempt to create mapping with non-ascii user name which is encoded in SINGLE-BYTE codepage leads to '-Malformed string'
18 SS 2022.02.02 14:46 284 283 284 281 279 281 283 278 322 363 365 236 157 157 157 156 156 156 X X X X X X X X X X X X
Bugcheck could happen when read-only database with non-zero linger is set to read-write mode
19 SS 2023.05.24 17:29 357 353 328 331 328 341 332 336 380 431 404 285 187 187 187 188 188 186 X X X X X X X X X X X X
RELEASE SAVEPOINT ONLY works incorrectly
20 SS 2024.12.29 08:33 258 267 252 253 506 269 255 253 297 350 355 205 125 125 126 125 125 124 X X X X X X X X X X X X
Alter database: adding a secondary file
21 SS 2023.10.06 13:04 343 345 347 347 351 331 347 340 390 440 407 309 203 204 204 203 203 203 X X X X X X X X X X X X
CREATE DOMAIN using 'CHARACTER VARYING' keyword
22 SS 2023.10.09 08:11 360 360 372 376 354 358 360 366 390 455 425 339 219 219 219 219 219 218 X X X X X X X X X X X X
CREATE DOMAIN. Check ability to declare using syntax BLOB(seglen, num_subtype)

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-210
http://tracker.firebirdsql.org/browse/CORE-3311
http://tracker.firebirdsql.org/browse/CORE-3475
http://tracker.firebirdsql.org/browse/CORE-3546
http://tracker.firebirdsql.org/browse/CORE-3553
http://tracker.firebirdsql.org/browse/CORE-4058
http://tracker.firebirdsql.org/browse/CORE-4645
http://tracker.firebirdsql.org/browse/CORE-4678
http://tracker.firebirdsql.org/browse/CORE-5246
http://tracker.firebirdsql.org/browse/CORE-5364
http://tracker.firebirdsql.org/browse/CORE-5434
http://tracker.firebirdsql.org/browse/CORE-5569
http://tracker.firebirdsql.org/browse/CORE-5783
http://tracker.firebirdsql.org/browse/CORE-5793
http://tracker.firebirdsql.org/browse/CORE-5904
http://tracker.firebirdsql.org/browse/CORE-5908
http://tracker.firebirdsql.org/browse/CORE-5926
http://tracker.firebirdsql.org/browse/CORE-5949
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_17.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_31.py
https://github.com/FirebirdSQL/firebird/issues/7591
=== end of list ===

Last commits information (all timestamps in UTC):