01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (14 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (30 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (43 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2445 rows)
12. Skipped: tests which was intentionally excluded from execution (75 rows)

Generated UTC 17.02.2025 08:05
Tested: HQ40.   Build / date: 4.0.6.3183-cf6ca3ce / 2025.02.16;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
4.0.6.3183
2025.02.16
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X
Test TITLE
1 CS P P P P P P P F P P P P P P X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2 CS F F F F F F F F F P P P P P X X X X X X X X X X X X X X X X
Compress Data over the Network
3 SS F F F F F F F F F P P P P P X X X X X X X X X X X X X X X X
Compress Data over the Network
4 CS P P P P P P P P P F F S S S X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5 SS P P P P P P P P P F F S S S X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6 CS X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7 SS X X X X X X X X X X F X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8 CS P P P P P P P F F F F X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9 SS P P P P P P P F F F F X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10 CS P P P F P P P P P P P P P P X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS P P P P P P P F P P P P P P X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12 SS P P P P P P P P P P F P P P X X X X X X X X X X X X X X X X
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13 CS X X X X F X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
14 SS X X X X F X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
15 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Backup error for wide table
16 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Backup error for wide table
17 CS P P P P P P P P P P P P F P X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
18 SS P P P P P P P P P P P P F P X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
19 CS P P P P P P P P P P P P F X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
20 SS P P P P P P P P P P P P F X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
21 CS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
22 SS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
23 CS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
24 SS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
25 CS P P P P P P P F F X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
26 SS P P P P P P P F F X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
27 CS P P P P P P P F X X X X X X X X X X X X X X X X X X X X X X
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
28 CS P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
29 SS P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
30 CS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
31 SS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
32 SS P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Report unique usernames for isc_info_user_names
33 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
34 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
35 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
36 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
37 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
38 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
39 CS F F F F F F F X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
40 SS F F F F F F F X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
41 CS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
42 SS F F F X X X X X X X X X X X X X X X X X X X X X X X X X X X
Make asynchronous replica re-initialization reliable #8324
43 CS P P P P P P P P P F P P P P X X X X X X X X X X X X X X X X
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3183
2025.02.16
4.0.6.3169
2024.12.13
4.0.6.3169
2024.12.08
4.0.6.3168
2024.11.28
4.0.6.3163
2024.10.16
4.0.6.3163
2024.10.15
4.0.6.3147
2024.08.31
4.0.6.3140
2024.08.16
4.0.6.3140
2024.08.09
4.0.5.3110
2024.07.30
4.0.5.3109
2024.06.11
4.0.5.3097
2024.05.09
4.0.5.3091
2024.04.29
4.0.5.3089
2024.04.25
X X X X X X X X X X X X X X X X
Test TITLE
1 CS 9534 14562 14686 9377 9207 9289 7994 9691 23425 12385 13028 12534 9206 8182 8704 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Count (DISTINCT ...) is too slow
2 CS 574 656 670 543 529 557 502 591 1645 675 700 455 634 448 435 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
3 SS 409 502 523 390 361 408 357 441 1030 469 517 345 410 298 264 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
4 CS 2066 2678 2478 1969 2101 1996 1958 2031 3607 2118 2126 1912 2289 1915 1966 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5 SS 1915 2672 2256 1844 1723 1886 1818 1967 3000 2215 1945 1779 2001 1825 1749 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6 CS 1883 0 0 0 0 0 0 0 0 0 0 1883 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7 SS 1430 0 0 0 0 0 0 0 0 0 0 1430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8 CS 917 940 917 777 730 789 696 743 1956 16271 17889 37494 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9 SS 702 702 722 536 523 562 537 573 1319 15678 38910 41672 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10 CS 766 799 813 779 628 688 726 754 1545 799 1179 624 799 517 599 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11 SS 474 593 558 413 426 462 426 486 882 551 590 408 582 350 344 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
12 SS 2722 2824 2874 2697 2636 2674 2626 2749 3554 2820 2822 2620 2748 2552 2559 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13 CS 547 0 0 0 0 547 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
14 SS 384 0 0 0 0 384 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
15 CS 528 693 632 530 500 526 483 525 1028 691 613 426 633 382 419 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
16 SS 368 469 461 337 346 385 349 351 705 499 517 275 403 260 270 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
17 CS 566 688 641 480 491 518 494 614 1389 667 930 499 643 373 393 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
18 SS 373 493 423 344 346 371 343 375 1260 487 474 303 418 278 265 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
19 CS 551 700 718 519 491 524 496 551 1337 677 771 419 775 520 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
20 SS 378 440 495 364 369 361 378 358 649 478 505 333 560 364 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
21 CS 551 687 745 551 475 493 493 542 1071 667 601 430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
22 SS 388 481 469 350 346 376 346 388 661 456 502 360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
23 CS 9478 13201 11953 9465 9180 9478 8855 9547 20215 9830 9420 2606 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
24 SS 9604 12198 12506 9331 9024 9391 8712 9799 15506 9604 9616 2473 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
25 CS 540 651 639 516 485 529 485 540 1743 2568 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
26 SS 15608 17000 17199 15608 14744 16038 14582 16315 1721 2399 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
27 CS 838 948 1037 785 785 823 805 854 2886 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
28 CS 6 10 7 5 7 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
29 SS 7 11 9 6 4 7 5 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
30 CS 2421 1649 1729 2455 2426 2421 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
31 SS 2246 1357 1466 2290 2246 2266 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
32 SS 16732 16764 16701 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Report unique usernames for isc_info_user_names
33 CS 619 698 797 639 574 539 511 600 1424 749 1142 492 668 416 465 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
34 SS 436 481 478 431 453 415 373 388 819 529 511 366 441 293 318 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
35 CS 689 877 763 679 635 700 663 679 1488 885 1277 612 862 540 553 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
36 SS 508 595 615 460 451 523 466 494 903 638 625 468 563 374 391 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
37 CS 7 8 7 6 5 6 8 7 7 7 28 9 6 8 8 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
38 SS 6 10 6 5 5 6 4 6 9 7 6 7 5 7 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
39 CS 545 682 691 545 517 524 506 573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
40 SS 363 474 443 324 363 362 342 363 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
41 CS 40325 47965 40325 33859 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
42 SS 40699 45086 40699 29983 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make asynchronous replica re-initialization reliable #8324
43 CS 549 696 670 517 514 543 508 555 1022 653 1083 483 637 372 411 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-5229
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intl/test_non_ascii_firebird_and_trace_utf8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_make_async_reinit_reliable.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/6282
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7269
https://github.com/FirebirdSQL/firebird/issues/7436
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/8104
https://github.com/FirebirdSQL/firebird/issues/8178
https://github.com/FirebirdSQL/firebird/issues/8211
https://github.com/FirebirdSQL/firebird/issues/8221
https://github.com/FirebirdSQL/firebird/issues/8253
https://github.com/FirebirdSQL/firebird/issues/8304
https://github.com/FirebirdSQL/firebird/issues/8353
=== end of list ===

Last commits information (all timestamps in UTC):