01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (5 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (39 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (2438 rows)
12. Skipped: tests which was intentionally excluded from execution (73 rows)

Generated UTC 03.12.2024 11:50
Tested: HQ40.   Build / date: 4.0.6.3168-481494ef / 2024.11.28;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS P P P P F P P P P P P X X X X X X X X X X X X X X X X X X X
Count (DISTINCT ...) is too slow
2
bugs core 0733 
 tracker
 CS F F F F F F P P P P P X X X X X X X X X X X X X X X X X X X
Compress Data over the Network
3
bugs core 0733 
 tracker
 SS F F F F F F P P P P P X X X X X X X X X X X X X X X X X X X
Compress Data over the Network
4
bugs core 5229 
 tracker
 CS P P P P P P F F S S S X X X X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5
bugs core 5229 
 tracker
 SS P P P P P P F F S S S X X X X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6
bugs gh 4723 incompressible 
 tracker
 CS X X X X X X X F X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7
bugs gh 4723 incompressible 
 tracker
 SS X X X X X X X F X X X X X X X X X X X X X X X X X X X X X X
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8
bugs gh 6282 
 tracker
 CS P P P P F F F F X X X X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9
bugs gh 6282 
 tracker
 SS P P P P F F F F X X X X X X X X X X X X X X X X X X X X X X
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10
bugs gh 6875 
 tracker
 SS P P P P F P P P P P P X X X X X X X X X X X X X X X X X X X
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7200 
 tracker
 SS P P P P P P P F P P P X X X X X X X X X X X X X X X X X X X
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
12
bugs gh 7269 
 tracker
 CS X F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
13
bugs gh 7269 
 tracker
 SS X F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
Database restore must make every effort on activating deferred indexes
14
bugs gh 7436 
 tracker
 CS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
Backup error for wide table
15
bugs gh 7436 
 tracker
 SS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
Backup error for wide table
16
bugs gh 7818 
 tracker
 CS P P P P P P P P P F P X X X X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
17
bugs gh 7818 
 tracker
 SS P P P P P P P P P F P X X X X X X X X X X X X X X X X X X X
Extend rdb$get_context('SYSTEM', '***') with client-related info
18
bugs gh 8104 
 tracker
 CS P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
19
bugs gh 8104 
 tracker
 SS P P P P P P P P P F X X X X X X X X X X X X X X X X X X X X
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
20
bugs gh 8178 addi 
 tracker
 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
21
bugs gh 8178 addi 
 tracker
 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
22
bugs gh 8178 
 tracker
 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
23
bugs gh 8178 
 tracker
 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
24
bugs gh 8211 
 tracker
 CS P P P P F F X X X X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
25
bugs gh 8211 
 tracker
 SS P P P P F F X X X X X X X X X X X X X X X X X X X X X X X X
DATEADD truncates milliseconds for month and year deltas.
26
bugs gh 8221 
 tracker
 CS P P P P F X X X X X X X X X X X X X X X X X X X X X X X X X
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
27
bugs gh 8253 
 tracker
 CS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
28
bugs gh 8253 
 tracker
 SS P P P F X X X X X X X X X X X X X X X X X X X X X X X X X X
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
29
bugs gh 8304 
 tracker
 CS P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
30
bugs gh 8304 
 tracker
 SS P F X X X X X X X X X X X X X X X X X X X X X X X X X X X X
wrong results using minvalue/maxvalue in join condition
31
functional arno optimizer opt sort by index 10 
 CS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
32
functional arno optimizer opt sort by index 10 
 SS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
33
functional arno optimizer opt sort by index 13 
 CS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
34
functional arno optimizer opt sort by index 13 
 SS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi)
35
functional arno optimizer opt sort by index 19 
 CS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
36
functional arno optimizer opt sort by index 19 
 SS F F F F F F F F F F F X X X X X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
37
functional intl non ascii firebird and trace utf8 
 CS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
38
functional intl non ascii firebird and trace utf8 
 SS F F F F X X X X X X X X X X X X X X X X X X X X X X X X X X
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
39
functional session ext conn pool 01 
 CS P P P P P P F P P P P X X X X X X X X X X X X X X X X X X X
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms
4.0.6.3168
2024.11.28
48149
4.0.6.3163
2024.10.16
2bb10
4.0.6.3163
2024.10.15
f387e
4.0.6.3147
2024.08.31
4655b
4.0.6.3140
2024.08.16
1dd8b
4.0.6.3140
2024.08.09
34747
4.0.5.3110
2024.07.30
c6527
4.0.5.3109
2024.06.11
6addf
4.0.5.3097
2024.05.09
27fa6
4.0.5.3091
2024.04.29
bd0aa
4.0.5.3089
2024.04.25
4b9c7
X X X X X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0214 
 tracker
 CS 9289 8517 9289 7994 9691 23425 12385 13028 12534 9206 8182 8704 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Count (DISTINCT ...) is too slow
2
bugs core 0733 
 tracker
 CS 557 523 557 502 591 1645 675 700 455 634 448 435 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
3
bugs core 0733 
 tracker
 SS 408 365 408 357 441 1030 469 517 345 410 298 264 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
4
bugs core 5229 
 tracker
 CS 2010 2010 1996 1958 2031 3607 2118 2126 1912 2289 1915 1966 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
5
bugs core 5229 
 tracker
 SS 1886 1796 1886 1818 1967 3000 2215 1945 1779 2001 1825 1749 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
6
bugs gh 4723 incompressible 
 tracker
 CS 1883 0 0 0 0 0 0 0 1883 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
7
bugs gh 4723 incompressible 
 tracker
 SS 1430 0 0 0 0 0 0 0 1430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Optimize the record-level RLE algorithm for a denser compression of shorter-than-declared strings and sets of subsequent NULLs [CORE4401]
8
bugs gh 6282 
 tracker
 CS 1372 728 789 696 743 1956 16271 17889 37494 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
9
bugs gh 6282 
 tracker
 SS 946 523 562 537 573 1319 15678 38910 41672 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add DPB properties for time zone bind and decfloat configuration [CORE6032]
10
bugs gh 6875 
 tracker
 SS 462 429 462 426 486 882 551 590 408 582 350 344 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7200 
 tracker
 SS 2674 2668 2674 2626 2749 3554 2820 2822 2620 2748 2552 2559 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
12
bugs gh 7269 
 tracker
 CS 547 0 547 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
13
bugs gh 7269 
 tracker
 SS 384 0 384 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Database restore must make every effort on activating deferred indexes
14
bugs gh 7436 
 tracker
 CS 526 540 526 483 525 1028 691 613 426 633 382 419 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
15
bugs gh 7436 
 tracker
 SS 351 339 385 349 351 705 499 517 275 403 260 270 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Backup error for wide table
16
bugs gh 7818 
 tracker
 CS 518 477 518 494 614 1389 667 930 499 643 373 393 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
17
bugs gh 7818 
 tracker
 SS 375 379 371 343 375 1260 487 474 303 418 278 265 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Extend rdb$get_context('SYSTEM', '***') with client-related info
18
bugs gh 8104 
 tracker
 CS 537 491 524 496 551 1337 677 771 419 775 520 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
19
bugs gh 8104 
 tracker
 SS 371 352 361 378 358 649 478 505 333 560 364 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Inefficient evaluation of expressions like rdb$db_key <= ? after mass delete
20
bugs gh 8178 addi 
 tracker
 CS 519 496 493 493 542 1071 667 601 430 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
21
bugs gh 8178 addi 
 tracker
 SS 382 347 376 346 388 661 456 502 360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
22
bugs gh 8178 
 tracker
 CS 9449 9251 9478 8855 9547 20215 9830 9420 2606 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
23
bugs gh 8178 
 tracker
 SS 9497 9096 9391 8712 9799 15506 9604 9616 2473 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
24
bugs gh 8211 
 tracker
 CS 534 464 529 485 540 1743 2568 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
25
bugs gh 8211 
 tracker
 SS 14827 15073 16038 14582 16315 1721 2399 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
DATEADD truncates milliseconds for month and year deltas.
26
bugs gh 8221 
 tracker
 CS 823 786 823 805 854 2886 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Crash when MAKE_DBKEY() is called with 0 or 1 arguments
27
bugs gh 8253 
 tracker
 CS 6 4 6 6 6 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
28
bugs gh 8253 
 tracker
 SS 6 4 7 5 7 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Incorrect handling of non-ASCII object names in CREATE MAPPING statement
29
bugs gh 8304 
 tracker
 CS 2404 2387 2421 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
30
bugs gh 8304 
 tracker
 SS 2273 2281 2266 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wrong results using minvalue/maxvalue in join condition
31
functional arno optimizer opt sort by index 10 
 CS 539 495 539 511 600 1424 749 1142 492 668 416 465 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
32
functional arno optimizer opt sort by index 10 
 SS 395 395 415 373 388 819 529 511 366 441 293 318 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
33
functional arno optimizer opt sort by index 13 
 CS 679 660 700 663 679 1488 885 1277 612 862 540 553 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
34
functional arno optimizer opt sort by index 13 
 SS 494 448 523 466 494 903 638 625 468 563 374 391 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi)
35
functional arno optimizer opt sort by index 19 
 CS 8 8 6 8 7 7 7 28 9 6 8 8 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
36
functional arno optimizer opt sort by index 19 
 SS 6 5 6 4 6 9 7 6 7 5 7 5 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ORDER BY ASC using index (multi) and WHERE clause
37
functional intl non ascii firebird and trace utf8 
 CS 522 520 524 506 573 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
38
functional intl non ascii firebird and trace utf8 
 SS 354 346 362 342 363 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check ability to obtain non-ascii content from firebird.log and trace when use ON DISCONNECT trigger and exception with non-ascii names, charset = UTF8.
39
functional session ext conn pool 01 
 CS 543 529 543 508 555 1022 653 1083 483 637 372 411 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-214
http://tracker.firebirdsql.org/browse/core-5229
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intl/test_non_ascii_firebird_and_trace_utf8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/4723
https://github.com/FirebirdSQL/firebird/issues/6282
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7269
https://github.com/FirebirdSQL/firebird/issues/7436
https://github.com/FirebirdSQL/firebird/issues/7818
https://github.com/FirebirdSQL/firebird/issues/8104
https://github.com/FirebirdSQL/firebird/issues/8178
https://github.com/FirebirdSQL/firebird/issues/8211
https://github.com/FirebirdSQL/firebird/issues/8221
https://github.com/FirebirdSQL/firebird/issues/8253
https://github.com/FirebirdSQL/firebird/issues/8304
=== end of list ===

Last commits information (all timestamps in UTC):