01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (3 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (38 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (2 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (3 rows)
11. All tests: outcomes for previous 30 runs (2038 rows)
12. Skipped: tests which was intentionally excluded from execution (61 rows)

Generated UTC 20.11.2024 12:41
Tested: HQ30.   Build / date: 3.0.13.33794-abe09c1a / 2024.10.15;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X X X X X X X
Test TITLE
1 CS P F P P P P P P P P P P P P X X X X X X X X X X X X X X X X
Count ( DISTINCT ... ) is too slow
2 CS P F F P P F P P P P P P P P X X X X X X X X X X X X X X X X
Compress Data over the Network
3 SS F F P F F P P P P P P P P P X X X X X X X X X X X X X X X X
Compress Data over the Network
4 SS P P P P P P P P F F F F F F X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
5 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
ISQL does not show encryption status of database
6 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
ISQL does not show encryption status of database
7 CS P P P P P P F F S S S S S S X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
8 SS P P P P P P F F S S S S S S X X X X X X X X X X X X X X X X
Allow to enforce IPv4 or IPv6 in URL-like connection strings
9 SS P P P P F P P P P P P P P P X X X X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
10 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
11 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
12 CS P P F P P F F F F F F F P P X X X X X X X X X X X X X X X X
Slow changes on domain
13 SS P P P P P P F F F F F F P P X X X X X X X X X X X X X X X X
Slow changes on domain
14 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Unique constraint not working in encrypted database on first command
15 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Unique constraint not working in encrypted database on first command
16 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
17 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
18 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
19 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
20 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Not user friendly output of gstat at encrypted database
21 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Not user friendly output of gstat at encrypted database
22 CS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
23 SS F F F F F F F F F F F F F F X X X X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
24 CS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Generator pages are not encrypted
25 SS P P P P P P P P P P P F F F X X X X X X X X X X X X X X X X
Generator pages are not encrypted
26 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Cardinality estimation should use primary record versions only
27 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Cardinality estimation should use primary record versions only
28 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
29 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Check result of conversion to string in COALESCE that involves all families of data types.
30 CS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
31 SS P P P P P P F F X X X X X X X X X X X X X X X X X X X X X X
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
32 CS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
33 SS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
34 CS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
35 SS X X X X X X X X X F X X X X X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
36 CS P P P P P P P P P P P P F F X X X X X X X X X X X X X X X X
INNER JOIN join order
37 SS P P P P P P P P P P P P F F X X X X X X X X X X X X X X X X
INNER JOIN join order
38 SS S F F F S S S S S S S S S S X X X X X X X X X X X X X X X X
CREATE VIEW as SELECT ....

Elapsed time, milliseconds:

NN Test name mode median_ms
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.14
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.23
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33745
2024.05.21
3.0.12.33745
2024.05.09
3.0.12.33744
2024.04.20
3.0.12.33740
2024.04.06
3.0.12.33726
2024.03.29
3.0.12.33726
2024.03.11
X X X X X X X X X X X X X X X X
Test TITLE
1 CS 1860 2128 2536 1974 2355 2836 2461 1957 1763 1656 1703 1641 1640 1656 1593 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Count ( DISTINCT ... ) is too slow
2 CS 24876 18396 18238 19705 20122 18459 21482 26695 26930 25362 26722 25362 25019 25002 24751 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
3 SS 23856 17404 17688 17908 17750 18040 17101 26295 25293 25206 27706 24440 24034 23893 23819 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Compress Data over the Network
4 SS 82686 82401 83853 83857 82488 85027 84089 84671 85087 79289 82884 78821 76305 78133 78648 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Better performance of creating packages containing many functions
5 CS 863 888 884 904 900 964 993 982 842 719 782 765 360 360 311 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL does not show encryption status of database
6 SS 444 479 466 493 466 509 596 578 422 344 328 328 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ISQL does not show encryption status of database
7 CS 854 1495 854 854 893 904 958 1280 1107 16 0 16 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
8 SS 376 378 381 378 375 457 478 772 635 0 0 0 0 0 14 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow to enforce IPv4 or IPv6 in URL-like connection strings
9 SS 18471 18608 18496 18546 18447 18782 18798 18846 18921 16596 18112 16611 16486 16471 16501 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Performance regression when bulk inserting into table with indices
10 CS 2634 3055 2812 2510 2759 2542 2642 2627 2450 3844 4000 3813 1234 1204 1156 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
11 SS 1754 1726 1703 1686 1701 1782 1817 1804 2172 3031 3297 3031 593 594 577 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
12 CS 7788 7734 7703 7634 7694 7661 7843 13255 13348 12329 12313 12485 11579 6923 6813 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
13 SS 6934 6584 6629 6539 7067 6802 6761 11553 11586 10329 10798 10407 9985 5875 5890 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
14 CS 1058 1665 1074 1079 1071 1103 1177 1180 1046 938 938 938 547 516 484 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
15 SS 596 634 599 594 633 652 688 695 608 453 454 453 234 235 234 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unique constraint not working in encrypted database on first command
16 CS 450 545 497 490 492 540 583 573 410 375 360 375 359 359 311 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
17 SS 224 251 268 249 257 282 360 325 199 125 125 114 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
18 CS 5821 5815 5831 5832 5803 5918 6346 6243 6148 5657 5688 5828 5454 5516 5422 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
19 SS 5970 6002 6163 5982 5968 5889 6074 6100 5975 5547 5782 5972 5344 5407 5453 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
20 CS 629 678 669 660 671 713 761 752 599 547 563 547 360 360 312 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
21 SS 336 361 359 362 369 402 435 428 313 219 234 235 125 125 124 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Not user friendly output of gstat at encrypted database
22 CS 813 1196 852 894 1186 1235 958 961 774 562 656 610 609 625 593 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
23 SS 459 463 459 794 517 576 914 606 459 438 438 437 406 406 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
24 CS 787 844 845 843 832 877 963 919 742 718 703 719 531 531 468 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Generator pages are not encrypted
25 SS 434 479 473 459 473 521 549 540 409 313 312 328 234 234 233 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Generator pages are not encrypted
26 CS 1081 1056 1045 1043 1106 1139 1220 1213 1025 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Cardinality estimation should use primary record versions only
27 SS 869 828 847 833 826 929 1017 999 891 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Cardinality estimation should use primary record versions only
28 CS 1439 1415 1439 1435 1439 1467 1516 1567 1385 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
29 SS 1200 1153 1227 1177 1164 1223 1255 1293 1151 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Check result of conversion to string in COALESCE that involves all families of data types.
30 CS 607 587 593 583 622 633 678 661 485 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
31 SS 368 327 379 347 361 375 731 404 282 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Problem with boolean conversion to string inside DataTypeUtil::makeFromList()
32 CS 2625 0 0 0 0 0 0 0 0 0 2625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
33 SS 2359 0 0 0 0 0 0 0 0 0 2359 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
34 CS 2625 0 0 0 0 0 0 0 0 0 2625 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
35 SS 2360 0 0 0 0 0 0 0 0 0 2360 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
36 CS 807 854 855 861 859 889 1029 977 761 750 719 734 687 719 640 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order
37 SS 531 534 543 549 553 598 646 637 528 406 406 406 406 407 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
INNER JOIN join order
38 SS 383 366 10800308 10800318 10800306 348 312 322 318 406 406 391 375 406 250 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
CREATE VIEW as SELECT ....

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-214
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5229
http://tracker.firebirdsql.org/browse/core-5302
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5673
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5796
http://tracker.firebirdsql.org/browse/core-5831
http://tracker.firebirdsql.org/browse/core-6108
http://tracker.firebirdsql.org/browse/core-6163
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol_cr_space_nl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_10.py
https://github.com/FirebirdSQL/firebird/issues/8161
https://github.com/FirebirdSQL/firebird/issues/8178
=== end of list ===

Last commits information (all timestamps in UTC):