01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (4 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (44 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2444 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 16.01.2025 13:41
Tested: HQ40.   Build / date: 4.0.6.3169-42cc1914 / 2024.12.13;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X X
Test TITLE
1 CS P P P P P P F P P P P P P X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2 CS F F F F F F F F P P P P P X X X X X X X X X X X X X X X X X
Compress Data over the Network
3 SS F F F F F F F F P P P P P X X X X X X X X X X X X X X X X X
Compress Data over the Network
4 CS P P P P P P P P F F S S S X X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5 SS P P P P P P P P F F S S S X X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6 CS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7 SS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8 CS P P P P P P F F F F X X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9 SS P P P P P P F F F F X X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10 CS P P F P P P P P P P P P P X X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS P P P P P P F P P P P P P X X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12 SS F P P P P P P P P P X X X X X X X X X X X X X X X X X X X X
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
13 SS P P P P P P P P P F P P P X X X X X X X X X X X X X X X X X
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
14 CS X X X F X X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
15 SS X X X F X X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
16 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
Backup error for wide table
17 SS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
Backup error for wide table
18 CS P P P P P P P P P P P F P X X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
19 SS P P P P P P P P P P P F P X X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
20 CS P P P P P P P P P P P F X X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
21 SS P P P P P P P P P P P F X X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
22 CS P P P P P P P P F F X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
23 SS P P P P P P P P F F X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
24 CS P P P P P P P P F F X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
25 SS P P P P P P P P F F X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
26 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
27 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
28 CS P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
29 CS P P P P P F X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
30 SS P P P P P F X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
31 CS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
32 SS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
33 SS F X X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Report unique usernames for isc_info_user_names
34 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
35 SS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
36 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
37 SS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
38 CS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
39 SS F F F F F F F F F F F F F X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
40 CS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
41 SS F F F F F F X X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
42 CS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
43 SS F F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
44 CS P P P P P P P P F P P P P X X X X X X X X X X X X X X X X X
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X X
Test TITLE
1 CS 9377 15458 9377 9207 9289 7994 9691 23425 12385 13028 12534 9206 8182 8704 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Count (DISTINCT ...) is too slow
2 CS 557 703 543 529 557 502 591 1645 675 700 455 634 448 435 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
3 SS 408 473 390 361 408 357 441 1030 469 517 345 410 298 264 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
4 CS 2031 2606 1969 2101 1996 1958 2031 3607 2118 2126 1912 2289 1915 1966 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5 SS 1886 2338 1844 1723 1886 1818 1967 3000 2215 1945 1779 2001 1825 1749 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6 CS 1883 0 0 0 0 0 0 0 0 0 1883 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7 SS 1430 0 0 0 0 0 0 0 0 0 1430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8 CS 904 1019 777 730 789 696 743 1956 16271 17889 37494 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9 SS 633 693 536 523 562 537 573 1319 15678 38910 41672 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10 CS 754 898 779 628 688 726 754 1545 799 1179 624 799 517 599 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS 462 610 413 426 462 426 486 882 551 590 408 582 350 344 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12 SS 400 446 368 375 384 362 416 782 457 511 297 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
13 SS 2697 2827 2697 2636 2674 2626 2749 3554 2820 2822 2620 2748 2552 2559 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
14 CS 547 0 0 0 547 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
15 SS 384 0 0 0 384 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
16 CS 526 668 530 500 526 483 525 1028 691 613 426 633 382 419 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
17 SS 351 449 337 346 385 349 351 705 499 517 275 403 260 270 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
18 CS 518 704 480 491 518 494 614 1389 667 930 499 643 373 393 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
19 SS 371 404 344 346 371 343 375 1260 487 474 303 418 278 265 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
20 CS 537 657 519 491 524 496 551 1337 677 771 419 775 520 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
21 SS 373 493 364 369 361 378 358 649 478 505 333 560 364 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
22 CS 546 693 551 475 493 493 542 1071 667 601 430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
23 SS 382 460 350 346 376 346 388 661 456 502 360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
24 CS 9471 12082 9465 9180 9478 8855 9547 20215 9830 9420 2606 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
25 SS 9497 11407 9331 9024 9391 8712 9799 15506 9604 9616 2473 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
26 CS 534 665 516 485 529 485 540 1743 2568 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
27 SS 15176 17338 15608 14744 16038 14582 16315 1721 2399 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
28 CS 823 1053 785 785 823 805 854 2886 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
29 CS 6 9 5 7 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
30 SS 6 6 6 4 7 5 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
31 CS 2423 1549 2455 2426 2421 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
32 SS 2256 1330 2290 2246 2266 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
33 SS 2381 2381 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report unique usernames for isc_info_user_names
34 CS 600 749 639 574 539 511 600 1424 749 1142 492 668 416 465 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
35 SS 431 513 431 453 415 373 388 819 529 511 366 441 293 318 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
36 CS 679 844 679 635 700 663 679 1488 885 1277 612 862 540 553 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
37 SS 494 630 460 451 523 466 494 903 638 625 468 563 374 391 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
38 CS 7 8 6 5 6 8 7 7 7 28 9 6 8 8 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
39 SS 6 10 5 5 6 4 6 9 7 6 7 5 7 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
40 CS 534 700 545 517 524 506 573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
41 SS 362 451 324 363 362 342 363 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
42 CS 39168 44477 33859 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
43 SS 35204 40426 29983 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
44 CS 543 686 517 514 543 508 555 1022 653 1083 483 637 372 411 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-5229
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intl/test_non_ascii_firebird_and_trace_utf8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/6282
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7269
https://github.com/FirebirdSQL/firebird/issues/7436
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/8104
https://github.com/FirebirdSQL/firebird/issues/8178
https://github.com/FirebirdSQL/firebird/issues/8211
https://github.com/FirebirdSQL/firebird/issues/8221
https://github.com/FirebirdSQL/firebird/issues/8253
https://github.com/FirebirdSQL/firebird/issues/8304
https://github.com/FirebirdSQL/firebird/issues/8353
=== end of list ===

Last commits information (all timestamps in UTC):