01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (1130 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (24 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (1605 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (148 rows)
11. All tests: outcomes for previous 30 runs (3499 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 29.06.2025 02:54
Tested: FB60.   Build / date: 6.0.0.881-7035d6ee / 2025.06.27;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
Test TITLE
1 CS 2022.02.02 14:46
1045 647 1045 647 647 712 1036 712 1036 1101 1101 1101 1132 1144 1170 1170 1170 1160 1160 1093 1044 698 1044 1044 1097 1140
FIRST is applied before aggregation
2 CS 2022.02.02 14:46
991 580 580 757 757 757 757 757 672 672 672 702 702 702 699 699 699 699 729 1064 1111 1111 1111 1120 1120 1098
MERGE not correctly worked with parameters in MATCHING clause
3 CS 2023.10.05 09:23
1285 810 810 806 806 801 783 783 771 771 812 904 904 904 919 1355 1355 919 1357 1429 1357 1318 1318 1290 1290 1318
CREATE OR ALTER VIEW statement
4 CS 2023.11.25 16:21
1049 618 728 728 645 645 728 645 626 1055 647 645 645 645 645 645 661 661 1032 1032 1066 1100 1113 1113 1117 1117
Parameters order of EXECUTE BLOCK statement is reversed if called from EXECUTE STATEMENT
5 CS 2022.02.02 14:46
985 578 626 640 640 640 651 651 651 1024 645 622 622 622 622 605 629 657 1006 958 1006 1006 1052 1052 1052 1052
New EXECUTE STATEMENT implementation asserts or throws an error if used both before and after commin/rollback retaining
6 CS 2022.02.02 14:46
1159 749 749 757 757 757 815 815 888 1253 888 869 869 869 869 869 875 875 1282 1305 1336 1305 1391 1391 1384 1352
Domain-level CHECK constraints wrongly process NULL values
7 CS 2022.02.02 14:46
1209 773 773 772 772 772 906 906 906 1346 801 801 922 922 922 922 966 948 965 965 1338 1338 1449 1449 1449 1389
update or insert with gen_id() with wrong generator value
8 CS 2024.09.12 08:57
1005 637 637 654 648 648 654 654 648 1092 804 655 655 655 655 636 636 738 792 792 1084 1084 1120 1104 1104 1120
Don't work subquery in COALESCE
9 CS 2022.02.02 14:46
1054 610 599 604 604 604 657 657 657 1021 608 608 611 639 639 639 627 639 725 725 1064 1064 1064 1064 1064 1064
ALTER VIEW WITH CHECK OPTION crashes the engin
10 CS 2022.02.02 14:46
1288 750 750 809 750 750 809 980 980 1227 980 782 782 817 817 829 852 865 921 921 1228 1330 1371 1330 1330 1371
GROUP by and RDB$DB_KEY problems
11 CS 2022.02.02 14:46
1324 876 876 876 792 792 1304 1304 847 1351 847 825 842 842 842 842 847 886 970 970 1294 1311 1312 1312 1381 1403
Parts of RDB$DB_KEY of views may be inverted when using outer joins
12 CS 2025.06.26 14:00
1055 669 X X X X X X X X X X X 669 669 669 645 684 900 900 907 1107 1109 1107 1107 1106
Error messages after parameters substitution contains '\n' characters instead of line break
13 CS 2025.06.26 15:41
1695 1021 X X X X X X X X X X X 965 965 944 943 943 967 967 1088 1426 1647 1705 1705 1740
Nbackup as online dump
14 CS 2025.06.26 15:53
1146 742 X X X X X X X X X X X 734 734 734 734 752 752 752 752 1150 1161 1214 1216 1241
Implement domain check of input parameters of execute block
15 CS 2025.06.26 17:29
1009 666 X X X X X X X X X X X 667 666 666 643 667 659 674 674 912 1053 1084 1098 1100
ALTER TRIGGER / PROCEDURE wrong error message
16 SS 2023.11.12 10:17
X X X X X X X X X X X X X 1962 1304 1250 1204 1204 1204 1772 1772 1790 1981 2209 2268 2268
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
17 CS 2024.01.12 15:40
X X X X X X X X X X X X X 1248 751 1248 751 751 751 725 725 751 843 1209 1209 1209
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
18 CS 2024.01.23 05:23
X X X X X X X X X X X X X 1085 638 638 623 623 623 657 741 1083 1083 683 683 683
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
19 CS 2025.04.16 17:03
X X X X X X X X X X X X X 1776 1183 1183 1183 1206 1206 1206 1712 1733 1733 1168 1126 1126
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
20 CS 2024.10.26 08:21
X X X X X X X X X X X X X 1191 755 1313 858 888 858 858 742 742 740 740 742 1200
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
21 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1168 774 774 774 910 772 910 910 910 1363 1363 1344 877
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
22 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1388 913 913 913 888 888 888 995 1351 1351 1351 1351 1351
Check correct work fix with foreign key
23 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1223 775 1244 1244 1217 1192 1192 823 758 758 758 747 743
Zero divide in SP can crash database when call this SP several times
24 SS 2024.07.14 08:47
408 263 416 276 276 276 429 276 283 283 268 268 283 355 384 421 421 421 380 380 380 394 394 401 394 394
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
6.0.0.767
2025.05.01
6.0.0.762
2025.04.30
6.0.0.755
2025.04.29
6.0.0.753
2025.04.27
Test TITLE
1 CS 1179 601 1048 1045 647 616 1072 623 712 1036 1108 612 1132 1101 1049 1235 1170 1144 1249 1160 1220 698 1093 1044 660 642 1140 1097 1164 1167
FIRST is applied before aggregation
2 CS 1070 1073 569 991 580 577 1049 757 1059 564 672 1053 561 702 614 1129 1079 654 699 641 1064 729 1111 1367 1168 1077 1056 1120 1129 1098
MERGE not correctly worked with parameters in MATCHING clause
3 CS 1380 1285 810 1353 806 801 1278 783 1356 754 771 1417 760 812 904 1470 1355 791 919 1529 1357 840 1429 1605 1290 1318 860 1273 1347 1419
CREATE OR ALTER VIEW statement
4 CS 1063 558 595 1049 1062 618 728 645 626 1188 1060 584 565 1055 647 645 639 599 1099 661 1032 654 1100 1066 1113 1145 1117 1058 1132 981
Parameters order of EXECUTE BLOCK statement is reversed if called from EXECUTE STATEMENT
5 CS 1301 557 576 985 1099 578 626 640 651 1033 1024 556 645 1097 622 605 561 629 1111 578 1077 657 1006 958 1160 1052 1122 1046 1041 1143
New EXECUTE STATEMENT implementation asserts or throws an error if used both before and after commin/rollback retaining
6 CS 1662 705 721 1159 1343 749 704 757 815 1253 1298 747 888 1287 671 869 775 875 1282 794 1336 843 1305 1391 1403 1250 1486 1384 1352 1325
Domain-level CHECK constraints wrongly process NULL values
7 CS 1453 731 773 1209 1232 733 772 743 906 1346 1421 788 801 1418 738 922 966 789 1507 914 1353 948 965 1338 1555 1450 1449 1313 1362 1389
update or insert with gen_id() with wrong generator value
8 CS 1224 594 601 1005 1322 637 624 654 648 1177 1092 553 589 1094 804 655 632 636 1171 606 792 738 1128 1247 1084 1068 1120 1104 1141 1226
Don't work subquery in COALESCE
9 CS 1437 610 599 1076 1054 587 555 604 657 1021 1129 591 590 1325 608 672 611 639 1149 601 627 725 1180 1064 1083 1023 977 1077 1064 1196
ALTER VIEW WITH CHECK OPTION crashes the engin
10 CS 1522 715 709 1315 1288 750 694 809 735 1338 1350 980 733 1227 782 764 817 829 1439 852 865 921 1493 1228 1330 1371 1404 1243 1290 1409
GROUP by and RDB$DB_KEY problems
11 CS 1356 780 1324 1324 876 792 753 1304 744 1364 1351 825 847 1393 722 752 842 847 1380 803 970 886 1517 1311 1294 1381 1312 1446 1403 1433
Parts of RDB$DB_KEY of views may be inverted when using outer joins
12 CS 1167 627 X X X X X X X X X X X 1128 1055 669 645 644 1208 900 596 684 1109 907 1223 1107 1183 1106 1090 1032
Error messages after parameters substitution contains '\n' characters instead of line break
13 CS 1768 1021 X X X X X X X X X X X 1711 1695 965 944 943 1047 915 921 1088 967 1647 1426 1748 1705 1757 1584 1740
Nbackup as online dump
14 CS 1246 742 X X X X X X X X X X X 1146 1240 692 734 691 773 762 672 752 698 1161 1214 1150 1241 1216 1287 1246
Implement domain check of input parameters of execute block
15 CS 1139 641 X X X X X X X X X X X 1020 1009 666 614 667 643 964 587 674 659 912 1053 1100 1084 1101 1098 1160
ALTER TRIGGER / PROCEDURE wrong error message
16 SS X X X X X X X X X X X X X 1965 1962 1304 1250 2396 1204 1149 1160 1790 1981 1772 1677 2209 2435 2268 2482 2177
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
17 CS X X X X X X X X X X X X X 1464 643 1328 669 1248 751 1428 725 706 751 704 1484 1209 843 1321 912 1264
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
18 CS X X X X X X X X X X X X X 1085 604 1101 638 1210 589 611 623 741 1124 657 1083 1093 672 683 632 1055
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
19 CS X X X X X X X X X X X X X 1844 1776 1132 1043 2343 1183 1206 1052 1712 1733 1168 1947 2411 1126 1025 1104 2170
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
20 CS X X X X X X X X X X X X X 1191 667 1313 683 1591 755 1344 858 888 702 717 742 1350 740 676 1200 1455
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
21 CS X X X X X X X X X X X X X 1294 1307 689 774 1168 772 1411 760 910 758 1431 1363 877 1604 744 1344 789
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
22 CS X X X X X X X X X X X X X 1388 874 817 1529 1464 913 855 852 888 1421 995 1363 1351 804 1432 827 1396
Check correct work fix with foreign key
23 CS X X X X X X X X X X X X X 1223 775 725 1449 1574 769 1244 1217 823 1192 758 747 743 1320 1332 701 725
Zero divide in SP can crash database when call this SP several times
24 SS 408 263 416 194 416 210 429 276 224 529 445 268 283 231 263 355 384 421 497 421 380 301 336 461 401 394 190 416 255 453
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1624
http://tracker.firebirdsql.org/browse/CORE-1640
http://tracker.firebirdsql.org/browse/CORE-2036
http://tracker.firebirdsql.org/browse/CORE-2038
http://tracker.firebirdsql.org/browse/CORE-2039
http://tracker.firebirdsql.org/browse/CORE-2041
http://tracker.firebirdsql.org/browse/CORE-2051
http://tracker.firebirdsql.org/browse/CORE-2061
http://tracker.firebirdsql.org/browse/CORE-2067
http://tracker.firebirdsql.org/browse/CORE-2075
http://tracker.firebirdsql.org/browse/CORE-2140
http://tracker.firebirdsql.org/browse/CORE-2216
http://tracker.firebirdsql.org/browse/CORE-2230
http://tracker.firebirdsql.org/browse/CORE-2374
http://tracker.firebirdsql.org/browse/CORE-610
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_avoid_index_usage.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_insert_pk_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_division_by_zero_corrupts_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/7744
https://github.com/FirebirdSQL/firebird/issues/7899
https://github.com/FirebirdSQL/firebird/issues/7962
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8290
=== end of list ===

Last commits information (all timestamps in UTC):