01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (1 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (38 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2038 rows)
12. Skipped: tests which was intentionally excluded from execution (61 rows)

Generated UTC 17.01.2025 12:49
Tested: HQ30.   Build / date: 3.0.13.33796-99b3bbff / 2025.01.14;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X X X X
Test TITLE
1 CS X X P P F P P P P P P P P P P P P X X X X X X X X X X X X X
Count ( DISTINCT ... ) is too slow
2 CS F F F F F F P P F P P P P P P P P X X X X X X X X X X X X X
Compress Data over the Network
3 SS F F F F F P F F P P P P P P P P P X X X X X X X X X X X X X
Compress Data over the Network
4 SS P P P P P P P P P P P F F F F F F X X X X X X X X X X X X X
Better performance of creating packages containing many functions
5 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
ISQL does not show encryption status of database
6 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
ISQL does not show encryption status of database
7 CS P P P P P P P P P F F S S S S S S X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
8 SS P P P P P P P P P F F S S S S S S X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
9 SS P P P P P P P F P P P P P P P P P X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
10 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
11 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
12 CS P F P P P F P P F F F F F F F P P X X X X X X X X X X X X X
Slow changes on domain
13 SS P P P P P P P P P F F F F F F P P X X X X X X X X X X X X X
Slow changes on domain
14 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Unique constraint not working in encrypted database on first command
15 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Unique constraint not working in encrypted database on first command
16 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
17 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
18 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
19 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
20 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Not user friendly output of gstat at encrypted database
21 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Not user friendly output of gstat at encrypted database
22 CS F F F F F F F F F F F F F F F F F X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
23 SS F F F F F F F F F F F F F F F F F X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
24 CS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Generator pages are not encrypted
25 SS P P P P P P P P P P P P P P F F F X X X X X X X X X X X X X
Generator pages are not encrypted
26 CS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Cardinality estimation should use primary record versions only
27 SS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Cardinality estimation should use primary record versions only
28 CS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
29 SS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
30 CS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
31 SS P P P P P P P P P F F X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
32 CS X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
33 SS X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
34 CS X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
35 SS X X X X X X X X X X X X F X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
36 CS P P P P P P P P P P P P P P P F F X X X X X X X X X X X X X
INNER JOIN join order
37 SS P P P P P P P P P P P P P P P F F X X X X X X X X X X X X X
INNER JOIN join order
38 SS S S S S F F F S S S S S S S S S S X X X X X X X X X X X X X
CREATE VIEW as SELECT ....

Elapsed time, milliseconds:

NN Test name mode median_ms
3.0.13.33796
2025.01.14
3.0.13.33795
2024.12.13
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X X X X
Test TITLE
1 CS 1957 0 0 2015 2056 2536 1974 2355 2836 2461 1957 1763 1656 1703 1641 1640 1656 1593 0 0 0 0 0 0 0 0 0 0 0 0 0
Count ( DISTINCT ... ) is too slow
2 CS 21482 18519 21295 18676 19371 18238 19705 20122 18459 21482 26695 26930 25362 26722 25362 25019 25002 24751 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
3 SS 18040 17480 17393 17425 17288 17688 17908 17750 18040 17101 26295 25293 25206 27706 24440 24034 23893 23819 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
4 SS 82924 82958 83292 82924 82923 83853 83857 82488 85027 84089 84671 85087 79289 82884 78821 76305 78133 78648 0 0 0 0 0 0 0 0 0 0 0 0 0
Better performance of creating packages containing many functions
5 CS 884 885 885 880 885 884 904 900 964 993 982 842 719 782 765 360 360 311 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL does not show encryption status of database
6 SS 464 463 511 464 517 466 493 466 509 596 578 422 344 328 328 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL does not show encryption status of database
7 CS 858 858 866 875 864 854 854 893 904 958 1280 1107 16 0 16 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
8 SS 378 381 377 379 383 381 378 375 457 478 772 635 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
9 SS 18546 18949 18705 19023 18652 18496 18546 18447 18782 18798 18846 18921 16596 18112 16611 16486 16471 16501 0 0 0 0 0 0 0 0 0 0 0 0 0
Performance regression when bulk inserting into table with indices
10 CS 2627 2779 2480 2516 2866 2812 2510 2759 2542 2642 2627 2450 3844 4000 3813 1234 1204 1156 0 0 0 0 0 0 0 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
11 SS 1727 1697 1713 1727 1924 1703 1686 1701 1782 1817 1804 2172 3031 3297 3031 593 594 577 0 0 0 0 0 0 0 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
12 CS 7843 7625 7915 7694 8037 7703 7634 7694 7661 7843 13255 13348 12329 12313 12485 11579 6923 6813 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
13 SS 6799 6575 6799 6603 6698 6629 6539 7067 6802 6761 11553 11586 10329 10798 10407 9985 5875 5890 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
14 CS 1074 1076 1150 1116 1082 1074 1079 1071 1103 1177 1180 1046 938 938 938 547 516 484 0 0 0 0 0 0 0 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
15 SS 603 608 603 607 618 599 594 633 652 688 695 608 453 454 453 234 235 234 0 0 0 0 0 0 0 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
16 CS 492 545 494 500 599 497 490 492 540 583 573 410 375 360 375 359 359 311 0 0 0 0 0 0 0 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
17 SS 252 256 253 252 252 268 249 257 282 360 325 199 125 125 114 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
18 CS 5832 6644 5862 6246 6410 5831 5832 5803 5918 6346 6243 6148 5657 5688 5828 5454 5516 5422 0 0 0 0 0 0 0 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
19 SS 5972 5976 6005 6026 5898 6163 5982 5968 5889 6074 6100 5975 5547 5782 5972 5344 5407 5453 0 0 0 0 0 0 0 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
20 CS 666 666 700 678 718 669 660 671 713 761 752 599 547 563 547 360 360 312 0 0 0 0 0 0 0 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
21 SS 362 364 370 370 373 359 362 369 402 435 428 313 219 234 235 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
22 CS 857 857 860 861 915 852 894 1186 1235 958 961 774 562 656 610 609 625 593 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
23 SS 480 487 480 481 482 459 794 517 576 914 606 459 438 438 437 406 406 405 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
24 CS 817 817 817 885 812 845 843 832 877 963 919 742 718 703 719 531 531 468 0 0 0 0 0 0 0 0 0 0 0 0 0
Generator pages are not encrypted
25 SS 460 460 483 462 461 473 459 473 521 549 540 409 313 312 328 234 234 233 0 0 0 0 0 0 0 0 0 0 0 0 0
Generator pages are not encrypted
26 CS 1103 1048 1119 1055 1103 1045 1043 1106 1139 1220 1213 1025 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Cardinality estimation should use primary record versions only
27 SS 846 828 840 839 846 847 833 826 929 1017 999 891 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Cardinality estimation should use primary record versions only
28 CS 1439 1425 1454 1413 1450 1439 1435 1439 1467 1516 1567 1385 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
29 SS 1177 1168 1188 1172 1170 1227 1177 1164 1223 1255 1293 1151 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
30 CS 593 593 574 580 605 593 583 622 633 678 661 485 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
31 SS 357 330 330 337 357 379 347 361 375 731 404 282 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
32 CS 2625 0 0 0 0 0 0 0 0 0 0 0 0 2625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
33 SS 2359 0 0 0 0 0 0 0 0 0 0 0 0 2359 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
34 CS 2625 0 0 0 0 0 0 0 0 0 0 0 0 2625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
35 SS 2360 0 0 0 0 0 0 0 0 0 0 0 0 2360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
36 CS 856 941 856 876 871 855 861 859 889 1029 977 761 750 719 734 687 719 640 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order
37 SS 549 562 561 568 568 543 549 553 598 646 637 528 406 406 406 406 407 405 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order
38 SS 348 314 316 317 325 10800308 10800318 10800306 348 312 322 318 406 406 391 375 406 250 0 0 0 0 0 0 0 0 0 0 0 0 0
CREATE VIEW as SELECT ....

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-4880
http://tracker.firebirdsql.org/browse/CORE-5077
http://tracker.firebirdsql.org/browse/CORE-5229
http://tracker.firebirdsql.org/browse/CORE-5302
http://tracker.firebirdsql.org/browse/CORE-5501
http://tracker.firebirdsql.org/browse/CORE-5602
http://tracker.firebirdsql.org/browse/CORE-5673
http://tracker.firebirdsql.org/browse/CORE-5793
http://tracker.firebirdsql.org/browse/CORE-5796
http://tracker.firebirdsql.org/browse/CORE-5831
http://tracker.firebirdsql.org/browse/CORE-6108
http://tracker.firebirdsql.org/browse/CORE-6163
http://tracker.firebirdsql.org/browse/CORE-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol_cr_space_nl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_10.py
https://github.com/FirebirdSQL/firebird/issues/8161
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):