01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (14 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (1105 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (21 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (1874 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (124 rows)
11. All tests: outcomes for previous 30 runs (3633 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 02.07.2025 03:16
Tested: FB60.   Build / date: 6.0.0.889-969ac2c0 / 2025.07.01;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.889
2025.07.01
6.0.0.884
2025.06.30
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
Test TITLE
1 CS 2022.02.02 14:46
946 622 946 946 836 622 585 585 585 548 548 962 962 898 948 1001 950 950 977 977 977 987 1009 1009 1009 547
Server crash with isc_dsql_execute_immediate and zero length string
2 CS 2025.06.25 17:12
1111 712 687 687 687 X X X X X X X X X X 855 855 1060 1060 683 676 676 676 1065 1147 1147
Unnecessary index scan happens when the same index is mapped to both WHERE and ORDER BY clauses
3 CS 2025.06.25 17:11
1031 680 668 668 668 X X X X X X X X X X 706 706 1090 1090 928 753 928 928 1142 1142 1142
Unnecessary index scan happens when the same index is mapped to both WHERE and ORDER BY clauses
4 CS 2022.02.02 14:46
X X 1020 652 652 635 635 635 617 617 582 582 598 627 627 627 679 878 1014 878 878 878 693 693 1094 1094
ABS() rounds NUMERIC values
5 CS 2025.06.25 17:48
1056 678 624 624 624 X X X X X X X X X X 966 1072 1072 966 941 692 692 680 680 1043 1043
Correlated subquery is optimized badly if it depends on the union stream
6 CS 2022.02.02 14:46
X X 991 580 580 757 757 757 757 757 672 672 672 702 702 702 699 699 699 699 729 1064 1111 1111 1111 1120
MERGE not correctly worked with parameters in MATCHING clause
7 CS 2022.02.02 14:46
X X 940 576 569 576 576 634 634 827 827 601 601 747 747 1000 1100 1100 1135 1135 1078 1078 1078 1078 1110 1110
Floor & ceiling functions give wrong results with exact numeric arguments
8 CS 2025.06.25 19:08
1030 629 629 629 629 X X X X X X X X X X 641 1072 1085 1135 1135 1085 1085 997 997 1084 1141
Bug in create/alter Database trigger (with Russian comment)
9 CS 2022.02.02 14:46
X X 1324 876 876 876 792 792 1304 1304 847 1351 847 825 842 842 842 842 847 886 970 970 1294 1311 1312 1312
Parts of RDB$DB_KEY of views may be inverted when using outer joins
10 CS 2022.02.02 14:46
X X 949 616 949 616 616 701 701 624 624 624 624 680 1009 1090 1090 849 1121 849 700 700 700 700 1035 1035
AV using recursive query as subquery in SELECT list and ORDER'ing by them
11 CS 2022.02.02 14:46
X X 1206 747 1206 843 843 839 839 810 805 805 810 1272 1333 1368 1369 1368 1369 1369 1349 1349 1308 1308 1310 1312
Incorrect LEFT JOIN result using table and derived constant subquery
12 SS 2022.02.02 14:46
691 451 443 443 451 460 578 578 469 552 469 469 477 477 477 477 495 490 490 470 490 478 470 470 478 470
Statistics for any system index can not be updated/recalculated
13 SS 2025.03.19 14:03
697 409 682 668 668 508 668 668 692 692 749 692 568 543 542 529 529 524 542 544 559 559 559 559 557 546
ISQL: bad headers when text columns has >= 80 characters
14 SS 2023.11.12 10:17
X X X X X X X X X X X X X X X 1962 1304 1250 1204 1204 1204 1772 1772 1790 1981 2209
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
15 CS 2024.01.12 15:40
X X X X X X X X X X X X X X X 1248 751 1248 751 751 751 725 725 751 843 1209
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
16 CS 2024.01.23 05:23
X X X X X X X X X X X X X X X 1085 638 638 623 623 623 657 741 1083 1083 683
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
17 CS 2025.04.16 17:03
X X X X X X X X X X X X X X X 1776 1183 1183 1183 1206 1206 1206 1712 1733 1733 1168
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
18 CS 2024.10.26 08:21
X X X X X X X X X X X X X X X 1191 755 1313 858 888 858 858 742 742 740 740
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
19 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X 1168 774 774 774 910 772 910 910 910 1363 1363
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
20 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X 1388 913 913 913 888 888 888 995 1351 1351 1351
Check correct work fix with foreign key
21 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X 1223 775 1244 1244 1217 1192 1192 823 758 758 758
Zero divide in SP can crash database when call this SP several times

Elapsed time, milliseconds:

NN Test name mode
6.0.0.889
2025.07.01
6.0.0.884
2025.06.30
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
6.0.0.767
2025.05.01
6.0.0.762
2025.04.30
Test TITLE
1 CS 983 474 565 966 946 622 971 836 585 548 548 965 962 521 516 1067 1001 898 948 1108 950 987 977 635 1009 1017 1015 476 545 547
Server crash with isc_dsql_execute_immediate and zero length string
2 CS 1132 712 1255 1111 652 X X X X X X X X X X 687 642 855 1060 1115 683 1176 587 676 656 1260 1267 1065 1147 1107
Unnecessary index scan happens when the same index is mapped to both WHERE and ORDER BY clauses
3 CS 1097 680 1193 1031 603 X X X X X X X X X X 637 668 706 1129 1250 651 1090 928 753 616 1143 1142 1200 1124 1069
Unnecessary index scan happens when the same index is mapped to both WHERE and ORDER BY clauses
4 CS X X 1091 1020 652 1129 561 635 1053 617 1092 570 582 1068 568 598 627 679 1014 600 1138 878 1063 670 553 1231 693 1111 1094 964
ABS() rounds NUMERIC values
5 CS 1060 678 1090 1056 601 X X X X X X X X X X 555 624 1215 966 1072 1116 692 941 680 680 1273 639 1089 1043 954
Correlated subquery is optimized badly if it depends on the union stream
6 CS X X 1104 1073 569 991 580 577 1049 757 1059 564 672 1053 561 702 614 1129 1079 654 699 641 1064 729 1111 1367 1168 1077 1056 1120
MERGE not correctly worked with parameters in MATCHING clause
7 CS X X 1131 948 569 940 548 576 561 634 995 827 565 1036 577 601 747 1100 1000 1207 1135 1054 1176 761 1078 1277 1048 1110 1136 1047
Floor & ceiling functions give wrong results with exact numeric arguments
8 CS 1030 604 1109 1065 590 X X X X X X X X X X 629 585 1072 641 1156 1180 1085 1135 706 605 1303 997 1084 1191 1141
Bug in create/alter Database trigger (with Russian comment)
9 CS X X 1432 780 1324 1324 876 792 753 1304 744 1364 1351 825 847 1393 722 752 842 847 1380 803 970 886 1517 1311 1294 1381 1312 1446
Parts of RDB$DB_KEY of views may be inverted when using outer joins
10 CS X X 1115 565 982 949 616 585 1092 601 1008 701 587 624 583 1009 1090 680 1337 1121 672 849 1160 700 549 689 1035 1144 1102 974
AV using recursive query as subquery in SELECT list and ORDER'ing by them
11 CS X X 1361 736 1238 747 1206 745 1310 843 839 749 810 805 793 1272 1384 1368 1333 1378 1369 1349 1536 938 1308 1553 1260 1336 1310 1312
Incorrect LEFT JOIN result using table and derived constant subquery
12 SS 693 691 740 439 443 451 421 670 460 578 579 457 469 552 415 477 516 430 495 470 539 490 458 425 522 478 470 458 509 448
Statistics for any system index can not be updated/recalculated
13 SS 697 388 724 409 698 373 682 668 508 504 749 692 759 568 804 543 529 515 542 524 580 519 544 559 571 568 557 486 546 501
ISQL: bad headers when text columns has >= 80 characters
14 SS X X X X X X X X X X X X X X X 1965 1962 1304 1250 2396 1204 1149 1160 1790 1981 1772 1677 2209 2435 2268
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
15 CS X X X X X X X X X X X X X X X 1464 643 1328 669 1248 751 1428 725 706 751 704 1484 1209 843 1321
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
16 CS X X X X X X X X X X X X X X X 1085 604 1101 638 1210 589 611 623 741 1124 657 1083 1093 672 683
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
17 CS X X X X X X X X X X X X X X X 1844 1776 1132 1043 2343 1183 1206 1052 1712 1733 1168 1947 2411 1126 1025
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
18 CS X X X X X X X X X X X X X X X 1191 667 1313 683 1591 755 1344 858 888 702 717 742 1350 740 676
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
19 CS X X X X X X X X X X X X X X X 1294 1307 689 774 1168 772 1411 760 910 758 1431 1363 877 1604 744
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
20 CS X X X X X X X X X X X X X X X 1388 874 817 1529 1464 913 855 852 888 1421 995 1363 1351 804 1432
Check correct work fix with foreign key
21 CS X X X X X X X X X X X X X X X 1223 775 725 1449 1574 769 1244 1217 823 1192 758 747 743 1320 1332
Zero divide in SP can crash database when call this SP several times

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1506
http://tracker.firebirdsql.org/browse/CORE-1550
http://tracker.firebirdsql.org/browse/CORE-1582
http://tracker.firebirdsql.org/browse/CORE-1607
http://tracker.firebirdsql.org/browse/CORE-1624
http://tracker.firebirdsql.org/browse/CORE-1677
http://tracker.firebirdsql.org/browse/CORE-1694
http://tracker.firebirdsql.org/browse/CORE-2075
http://tracker.firebirdsql.org/browse/CORE-2783
http://tracker.firebirdsql.org/browse/CORE-3090
http://tracker.firebirdsql.org/browse/CORE-4950
http://tracker.firebirdsql.org/browse/CORE-6438
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_avoid_index_usage.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_insert_pk_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_division_by_zero_corrupts_db.py
https://github.com/FirebirdSQL/firebird/issues/7744
https://github.com/FirebirdSQL/firebird/issues/7899
https://github.com/FirebirdSQL/firebird/issues/7962
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8290
=== end of list ===

Last commits information (all timestamps in UTC):