01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (15 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (33 rows)
07. Has fails: tests with at least one fail for previous 30 runs (44 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2044 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated UTC 22.02.2025 13:54
Tested: HQ30.   Build / date: 3.0.13.33796-0ab85166 / 2025.01.29;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
494 473 473 473 513 513 513 299 X X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46
1039 817 10 7 7 9 10 9 X X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
3 SS 2022.02.02 14:46
491 373 14 6 6 8 8 7 X X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4 CS 2022.02.02 14:46
1124 825 10 8 8 8 10 8 X X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5 SS 2022.02.02 14:46
487 378 22 6 5 6 6 6 X X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 CS 2022.02.02 14:46
1307 1003 28 10 10 10 7 6 X X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
7 SS 2022.02.02 14:46
649 510 14 7 6 6 6 6 X X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
8 SS 2022.02.02 14:46
499 499 520 520 527 527 527 308 X X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
9 SS 2022.02.02 14:46
398 386 386 386 459 459 459 244 X X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
10 CS 2022.02.02 14:46
1296 936 9 9 9 9 7 6 X X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11 SS 2022.02.02 14:46
668 543 10 10 8 8 8 5 X X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
12 SS 2024.06.09 15:53
370 367 367 367 468 468 468 237 X X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
13 SS 2022.02.02 14:46
462 462 482 482 570 570 570 308 X X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
14 SS 2022.02.02 14:46
480 476 476 476 585 585 585 314 X X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
15 SS 2023.12.12 17:20
508 508 508 519 583 583 583 327 X X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
16 CS 2022.02.02 14:46
1394 1013 9 9 9 9 9 7 X X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
17 SS 2022.02.02 14:46
708 566 12 6 6 10 10 10 X X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
18 SS 2023.09.28 12:18
404 404 404 404 484 484 484 267 X X X X X X X X X X X X X X X X X X
User with DROP DATABASE privilege can't drop database
19 SS 2022.02.02 14:46
412 409 409 409 522 522 522 266 X X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
20 SS 2022.02.02 14:46
511 447 447 447 475 475 475 298 X X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
21 SS 2022.02.02 14:46
366 343 343 343 381 381 381 224 X X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
22 SS 2022.02.02 14:46
514 514 514 576 576 576 564 332 X X X X X X X X X X X X X X X X X X
UNIQUE / PRIMARY KEY constraint can be violated when AUTODDL = OFF and mixing commands for DDL and DML
23 SS 2022.02.02 14:46
511 467 467 467 553 553 553 311 X X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
24 SS 2023.05.13 17:29
52469 26132 26132 26132 26132 41331 41331 17076 X X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
25 SS 2022.02.04 18:05
484 475 475 475 575 575 575 316 X X X X X X X X X X X X X X X X X X
DATEADD
26 SS 2022.02.04 18:05
496 465 465 465 552 552 552 308 X X X X X X X X X X X X X X X X X X
DATEDIFF
27 SS 2022.02.04 18:05
457 416 416 416 554 554 554 258 X X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
28 CS 2022.02.04 18:05
4805 4244 8 6 6 6 6 6 X X X X X X X X X X X X X X X X X X
LEFT function
29 SS 2022.02.04 18:05
4261 3924 12 7 7 7 7 7 X X X X X X X X X X X X X X X X X X
LEFT function
30 CS 2022.02.04 18:05
4836 4297 10 7 7 7 9 7 X X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
31 SS 2022.02.04 18:05
4251 3934 10 8 8 8 8 7 X X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
32 SS 2022.02.04 18:05
542 481 481 481 613 613 613 320 X X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
33 SS 2023.10.09 09:14
360 364 364 377 458 458 458 234 X X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 494 537 508 359 410 473 808 513 669 299 265 279 X X X X X X X X X X X X X X X X X X
Server shutdown
2 CS 2022.02.02 14:46 1078 1090 1039 817 4 7 10 7 13 9 19 6 X X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
3 SS 2022.02.02 14:46 491 560 493 373 6 6 14 5 15 8 7 6 X X X X X X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4 CS 2022.02.02 14:46 1190 1163 1124 825 4 5 10 8 22 5 16 5 X X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5 SS 2022.02.02 14:46 546 567 487 378 5 6 22 5 5 9 6 7 X X X X X X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 CS 2022.02.02 14:46 1331 1307 1349 1003 5 28 10 4 15 7 6 5 X X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
7 SS 2022.02.02 14:46 748 715 649 510 5 7 14 5 6 5 11 8 X X X X X X X X X X X X X X X X X X
GROUP BY concatenation with empty string
8 SS 2022.02.02 14:46 561 499 524 360 410 520 942 599 527 308 286 300 X X X X X X X X X X X X X X X X X X
Problem with default value of SP parameter
9 SS 2022.02.02 14:46 438 398 428 305 350 386 852 459 538 234 237 244 X X X X X X X X X X X X X X X X X X
RIGHT() fails with multibyte text blobs > 1024 chars
10 CS 2022.02.02 14:46 1322 1338 1296 936 6 9 9 7 29 6 6 6 X X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11 SS 2022.02.02 14:46 716 668 674 543 7 5 10 10 8 5 5 5 X X X X X X X X X X X X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
12 SS 2024.06.09 15:53 370 396 383 258 301 367 1688 468 476 237 184 175 X X X X X X X X X X X X X X X X X X
role not passed on external execute stmt
13 SS 2022.02.02 14:46 520 462 516 373 433 482 1751 598 570 301 308 293 X X X X X X X X X X X X X X X X X X
Server bugchecks or crashes on exception in calculated index
14 SS 2022.02.02 14:46 489 513 480 389 425 476 1768 634 585 314 294 309 X X X X X X X X X X X X X X X X X X
Regression: Computed field returns null value inside BI trigger
15 SS 2023.12.12 17:20 532 543 508 381 445 519 1871 583 610 327 304 295 X X X X X X X X X X X X X X X X X X
ISQL -x does not output the START WITH clause of generators/sequences
16 CS 2022.02.02 14:46 1431 1394 1404 1013 6 6 9 9 19 7 5 5 X X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
17 SS 2022.02.02 14:46 734 781 708 566 6 6 12 6 13 10 10 5 X X X X X X X X X X X X X X X X X X
Bugcheck 167 (invalid SEND request)
18 SS 2023.09.28 12:18 430 423 404 267 347 404 760 484 513 267 260 234 X X X X X X X X X X X X X X X X X X
User with DROP DATABASE privilege can't drop database
19 SS 2022.02.02 14:46 467 412 419 314 377 409 1205 522 563 266 231 236 X X X X X X X X X X X X X X X X X X
Inconsistencies with PSQL FUNCTION vs UDF
20 SS 2022.02.02 14:46 555 534 511 364 415 447 855 475 572 284 286 298 X X X X X X X X X X X X X X X X X X
Server crashes when it run SQL
21 SS 2022.02.02 14:46 425 405 366 296 308 343 746 381 468 224 194 193 X X X X X X X X X X X X X X X X X X
request size limit exceeded when selecting from a table with large number of indicies
22 SS 2022.02.02 14:46 515 520 514 366 428 576 1282 597 564 332 300 265 X X X X X X X X X X X X X X X X X X
UNIQUE / PRIMARY KEY constraint can be violated when AUTODDL = OFF and mixing commands for DDL and DML
23 SS 2022.02.02 14:46 524 556 511 356 398 467 1371 553 609 311 274 272 X X X X X X X X X X X X X X X X X X
FETCH RELATIVE has an off by one error for the first row
24 SS 2023.05.13 17:29 61374 52469 54778 24436 23882 26132 83914 41331 17076 41944 2624 2613 X X X X X X X X X X X X X X X X X X
Slow performance when executing SQL scripts as non-SYSDBA user
25 SS 2022.02.04 18:05 488 500 484 382 475 418 1013 575 595 314 316 277 X X X X X X X X X X X X X X X X X X
DATEADD
26 SS 2022.02.04 18:05 539 506 496 362 421 465 1031 560 552 277 308 287 X X X X X X X X X X X X X X X X X X
DATEDIFF
27 SS 2022.02.04 18:05 469 457 469 306 380 416 787 570 554 258 228 214 X X X X X X X X X X X X X X X X X X
ASCII_CHAR( <number> )
28 CS 2022.02.04 18:05 5037 5096 4805 4244 6 6 8 6 6 6 17 6 X X X X X X X X X X X X X X X X X X
LEFT function
29 SS 2022.02.04 18:05 4261 4440 4409 3924 5 5 12 7 10 7 5 5 X X X X X X X X X X X X X X X X X X
LEFT function
30 CS 2022.02.04 18:05 4900 4836 4853 4297 6 5 10 7 9 5 17 5 X X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
31 SS 2022.02.04 18:05 4251 4758 4362 3934 4 7 10 8 16 7 5 6 X X X X X X X X X X X X X X X X X X
RIGHT( <string>, <number> )
32 SS 2022.02.04 18:05 556 544 542 371 477 481 1876 613 668 312 320 293 X X X X X X X X X X X X X X X X X X
CREATE PROCEDURE
33 SS 2023.10.09 09:14 360 418 364 275 287 377 1061 466 458 234 201 193 X X X X X X X X X X X X X X X X X X
All DB objects types must allow name COMMENT. Also, COMMENT ON ... must allow occurence of "comment" in it.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1
http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-2797
http://tracker.firebirdsql.org/browse/CORE-3228
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-4054
http://tracker.firebirdsql.org/browse/CORE-4075
http://tracker.firebirdsql.org/browse/CORE-4201
http://tracker.firebirdsql.org/browse/CORE-4205
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-5790
http://tracker.firebirdsql.org/browse/CORE-5905
http://tracker.firebirdsql.org/browse/CORE-6137
http://tracker.firebirdsql.org/browse/CORE-6216
http://tracker.firebirdsql.org/browse/CORE-6252
http://tracker.firebirdsql.org/browse/CORE-6486
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/date/test_dateadd_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/date/test_datediff_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_ascii_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_comment_in_object_names.py
https://github.com/FirebirdSQL/firebird/issues/6220
=== end of list ===

Last commits information (all timestamps in UTC):