01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (1178 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (35 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (1605 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (100 rows)
11. All tests: outcomes for previous 30 runs (3499 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 28.06.2025 02:34
Tested: FB60.   Build / date: 6.0.0.881-7035d6ee / 2025.06.27;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
Test TITLE
1 CS 2022.02.02 14:46
1190 765 867 786 867 786 867 786 1205 1146 1146 1146 1146 1146 1221 1221 1221 1221 1221 1251 1251 1251 1251 1324 1288 1324
Error with ABS in dialect 1
2 CS 2023.11.25 15:42
1225 812 784 742 784 784 1301 1301 1301 1100 796 796 1100 1357 1413 1413 1413 1219 899 785 899 899 1294 1294 1325 1373
Dropping and adding a domain constraint in the same transaction leaves incorrect dependencies
3 CS 2022.02.02 14:46
1298 773 933 933 933 933 1182 1182 1182 1066 896 835 896 896 1309 1309 1309 1309 1309 849 1372 1313 1372 1313 1313 1279
Set the fixed and documented check order for WHERE clause and other conditional sentences
4 CS 2022.02.02 14:46
990 652 658 658 658 658 1070 1070 1161 1070 657 657 792 777 777 777 777 740 740 1097 1120 1156 1178 1178 1156 1152
bad BLR -- invalid stream for union select
5 CS 2022.02.02 14:46
990 598 598 598 563 563 563 628 628 628 628 592 592 600 674 673 805 673 805 958 997 1001 1064 1096 1096 1064
When trying to show "conversion error", "arithmetic exception/string truncation" may appear instead, misleading the user
6 CS 2023.11.25 16:21
991 618 728 728 645 645 728 645 626 1055 647 645 645 645 645 645 661 661 1032 1032 1066 1100 1113 1113 1117 1117
Parameters order of EXECUTE BLOCK statement is reversed if called from EXECUTE STATEMENT
7 CS 2022.02.02 14:46
950 578 626 640 640 640 651 651 651 1024 645 622 622 622 622 605 629 657 1006 958 1006 1006 1052 1052 1052 1052
New EXECUTE STATEMENT implementation asserts or throws an error if used both before and after commin/rollback retaining
8 CS 2022.02.02 14:46
1159 749 749 757 757 757 815 815 888 1253 888 869 869 869 869 869 875 875 1282 1305 1336 1305 1391 1391 1384 1352
Domain-level CHECK constraints wrongly process NULL values
9 CS 2022.02.02 14:46
1209 773 773 772 772 772 906 906 906 1346 801 801 922 922 922 922 966 948 965 965 1338 1338 1449 1449 1449 1389
update or insert with gen_id() with wrong generator value
10 CS 2024.09.12 08:57
1005 637 637 654 648 648 654 654 648 1092 804 655 655 655 655 636 636 738 792 792 1084 1084 1120 1104 1104 1120
Don't work subquery in COALESCE
11 CS 2022.02.02 14:46
1054 610 599 604 604 604 657 657 657 1021 608 608 611 639 639 639 627 639 725 725 1064 1064 1064 1064 1064 1064
ALTER VIEW WITH CHECK OPTION crashes the engin
12 CS 2022.02.02 14:46
1218 750 750 809 750 750 809 980 980 1227 980 782 782 817 817 829 852 865 921 921 1228 1330 1371 1330 1330 1371
GROUP by and RDB$DB_KEY problems
13 CS 2025.06.26 14:00
1055 669 X X X X X X X X X X X 669 669 669 645 684 900 900 907 1107 1109 1107 1107 1106
Error messages after parameters substitution contains '\n' characters instead of line break
14 CS 2022.02.02 14:46
949 616 949 616 616 701 701 624 624 624 624 680 1009 1090 1090 849 1121 849 700 700 700 700 1035 1035 1035 1031
AV using recursive query as subquery in SELECT list and ORDER'ing by them
15 CS 2022.02.02 14:46
1597 1046 1512 1512 1512 1039 1039 1028 1028 1028 1042 1670 1670 1670 1664 1586 1586 1542 1542 1143 1143 1143 1545 1703 1721 1731
Problems with COMMENT ON and strings using introducer (charset)
16 CS 2023.12.10 10:12
1101 657 671 671 671 671 704 706 706 706 723 765 1139 1167 1200 1200 1167 1164 1164 1147 1073 1073 1151 1098 1150 1151
isql shouldn't display db and user name when extracting a script
17 CS 2023.05.13 04:42
1268 777 1268 935 935 935 935 906 783 783 846 906 1286 1356 1432 1432 1382 1382 1382 1321 1321 1400 1428 1400 1400 1431
Changing data that affects an expression index that contains references to null date fields fails
18 CS 2022.02.02 14:46
1512 919 1331 1133 1133 1133 1133 929 929 929 966 996 1206 1492 1509 1500 1500 1500 1509 1500 1586 1488 1638 1508 1540 1540
Cannot remove user with dot in login
19 CS 2022.02.02 14:46
1314 800 1412 938 938 938 938 902 864 864 902 1508 1508 1508 1547 1216 1216 1216 1308 1204 1308 1440 1440 1440 1487 1487
Outer ORDER BY clause has no effect
20 CS 2022.02.02 14:46
1227 789 1227 789 789 789 953 800 800 800 953 1289 1289 1289 1289 1289 1258 1258 1356 1256 1256 1376 1376 1272 1319 1319
String right truncation error when char column longer than 4096 bytes compared with string constant
21 CS 2022.02.02 14:46
1218 796 796 808 808 808 808 807 781 781 807 1261 1261 1261 1261 1191 1162 1162 1191 867 867 1275 1364 1275 1364 1276
Exception handling with EXECUTE STATEMENT
22 CS 2024.10.31 10:32
1178 764 764 924 924 924 924 719 714 714 719 1199 1199 1222 1222 1199 1202 1202 1202 894 1202 1415 1415 1319 1319 1319
Case-sensitive character class names in SIMILAR TO
23 CS 2023.12.10 10:22
1053 674 674 1105 1044 1044 1044 651 641 641 651 1072 1072 1072 1072 1049 1049 1049 1091 1049 964 964 1053 1005 1053 1062
count(*) from big table returns negative result
24 CS 2022.02.02 14:46
1015 667 667 1031 1003 1003 1003 600 592 592 600 947 947 989 989 947 934 934 934 812 812 1020 1033 1020 1020 1033
Incorrect ROW_COUNT value after SINGULAR condition
25 SS 2022.02.02 14:46
555 353 348 348 348 363 363 436 363 363 355 524 382 382 370 382 382 470 506 506 470 463 445 445 463 471
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
26 SS 2023.11.12 10:17
X X X X X X X X X X X X X 1962 1304 1250 1204 1204 1204 1772 1772 1790 1981 2209 2268 2268
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
27 CS 2024.01.12 15:40
X X X X X X X X X X X X X 1248 751 1248 751 751 751 725 725 751 843 1209 1209 1209
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
28 CS 2024.01.23 05:23
X X X X X X X X X X X X X 1085 638 638 623 623 623 657 741 1083 1083 683 683 683
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
29 CS 2025.04.16 17:03
X X X X X X X X X X X X X 1776 1183 1183 1183 1206 1206 1206 1712 1733 1733 1168 1126 1126
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
30 CS 2024.10.26 08:21
X X X X X X X X X X X X X 1191 755 1313 858 888 858 858 742 742 740 740 742 1200
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
31 SS 2025.04.25 10:09
540 355 355 355 425 444 477 536 477 492 554 554 551 554 554 662 662 662 577 465 465 465 516 562 562 562
Segmentation fault when running query with partition by and subquery
32 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1168 774 774 774 910 772 910 910 910 1363 1363 1344 877
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
33 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1388 913 913 913 888 888 888 995 1351 1351 1351 1351 1351
Check correct work fix with foreign key
34 CS 2022.02.04 18:05
X X X X X X X X X X X X X 1223 775 1244 1244 1217 1192 1192 823 758 758 758 747 743
Zero divide in SP can crash database when call this SP several times
35 SS 2024.07.14 08:47
416 263 416 276 276 276 429 276 283 283 268 268 283 355 384 421 421 421 380 380 380 394 394 401 394 394
crash on assert or memory corruption when too long username is used for authentication

Elapsed time, milliseconds:

NN Test name mode
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
6.0.0.767
2025.05.01
6.0.0.762
2025.04.30
6.0.0.755
2025.04.29
6.0.0.753
2025.04.27
Test TITLE
1 CS 1230 765 1290 742 1190 706 867 786 1205 707 1350 715 1288 1146 814 1345 710 1623 1221 813 1372 875 1251 1388 1249 1413 1082 1324 1288 1492
Error with ABS in dialect 1
2 CS 1379 812 1250 742 1225 784 728 740 1316 1311 1301 742 1100 785 796 1357 1438 1488 1413 785 1219 899 773 784 1325 1294 1373 1285 1403 1400
Dropping and adding a domain constraint in the same transaction leaves incorrect dependencies
3 CS 1298 729 718 1416 1324 773 933 753 1182 1348 1343 793 1066 896 743 835 1309 1455 1309 800 1392 849 1375 734 1372 1313 1586 909 1237 1279
Set the fixed and documented check order for WHERE clause and other conditional sentences
4 CS 1031 608 652 990 1136 567 658 653 1199 1070 1443 657 1161 656 650 792 1102 777 628 624 1097 740 1120 1178 1156 1202 1282 1152 667 652
bad BLR -- invalid stream for union select
5 CS 1064 565 582 990 1021 598 551 554 563 1102 1192 628 585 567 674 592 1128 600 805 673 997 639 958 1001 1167 1339 1064 1096 608 642
When trying to show "conversion error", "arithmetic exception/string truncation" may appear instead, misleading the user
6 CS 991 558 595 1049 1062 618 728 645 626 1188 1060 584 565 1055 647 645 639 599 1099 661 1032 654 1100 1066 1113 1145 1117 1058 1132 981
Parameters order of EXECUTE BLOCK statement is reversed if called from EXECUTE STATEMENT
7 CS 950 557 576 985 1099 578 626 640 651 1033 1024 556 645 1097 622 605 561 629 1111 578 1077 657 1006 958 1160 1052 1122 1046 1041 1143
New EXECUTE STATEMENT implementation asserts or throws an error if used both before and after commin/rollback retaining
8 CS 1299 705 721 1159 1343 749 704 757 815 1253 1298 747 888 1287 671 869 775 875 1282 794 1336 843 1305 1391 1403 1250 1486 1384 1352 1325
Domain-level CHECK constraints wrongly process NULL values
9 CS 1252 731 773 1209 1232 733 772 743 906 1346 1421 788 801 1418 738 922 966 789 1507 914 1353 948 965 1338 1555 1450 1449 1313 1362 1389
update or insert with gen_id() with wrong generator value
10 CS 1109 594 601 1005 1322 637 624 654 648 1177 1092 553 589 1094 804 655 632 636 1171 606 792 738 1128 1247 1084 1068 1120 1104 1141 1226
Don't work subquery in COALESCE
11 CS 1076 610 599 1076 1054 587 555 604 657 1021 1129 591 590 1325 608 672 611 639 1149 601 627 725 1180 1064 1083 1023 977 1077 1064 1196
ALTER VIEW WITH CHECK OPTION crashes the engin
12 CS 1218 715 709 1315 1288 750 694 809 735 1338 1350 980 733 1227 782 764 817 829 1439 852 865 921 1493 1228 1330 1371 1404 1243 1290 1409
GROUP by and RDB$DB_KEY problems
13 CS 1121 627 X X X X X X X X X X X 1128 1055 669 645 644 1208 900 596 684 1109 907 1223 1107 1183 1106 1090 1032
Error messages after parameters substitution contains '\n' characters instead of line break
14 CS 1066 565 982 949 616 585 1092 601 1008 701 587 624 583 1009 1090 680 1337 1121 672 849 1160 700 549 689 1035 1144 1102 974 976 1031
AV using recursive query as subquery in SELECT list and ORDER'ing by them
15 CS 1627 981 1046 1597 1816 886 1512 1039 1539 974 948 1028 1042 1711 1687 1670 1586 1527 1664 1542 1743 1143 989 1051 1545 1703 1721 1767 1761 1731
Problems with COMMENT ON and strings using introducer (charset)
16 CS 1211 654 1157 1101 611 657 671 704 1244 639 706 723 691 765 1139 1273 1167 1344 1200 1164 1147 802 1227 681 1073 1151 1228 1098 1150 1263
isql shouldn't display db and user name when extracting a script
17 CS 1279 768 1268 1326 730 777 1302 935 1348 757 773 906 783 846 1356 1487 1286 1478 1432 1382 1321 910 1428 760 1400 1431 1448 1323 1269 1436
Changing data that affects an expression index that contains references to null date fields fails
18 CS 1535 883 1591 1512 919 894 1331 1133 1531 929 929 881 996 966 1575 1905 1206 1492 1509 1500 1586 1039 1642 877 1697 1488 1638 1508 1540 1671
Cannot remove user with dot in login
19 CS 1314 760 1475 1412 778 800 1474 938 1371 840 822 902 864 1508 1547 1675 1167 1216 1564 1204 1308 919 1440 872 1596 1440 1668 1392 1487 1494
Outer ORDER BY clause has no effect
20 CS 1257 669 1234 1227 746 789 1551 779 1246 763 953 800 768 1306 1291 1289 1193 1258 1368 1356 1256 914 1376 831 1467 1415 1272 1193 1319 1431
String right truncation error when char column longer than 4096 bytes compared with string constant
21 CS 1218 1328 756 1229 796 748 1375 808 1216 715 767 807 781 1355 1421 1261 1120 1162 1298 1191 804 867 1403 804 1364 1275 1405 1251 1455 1276
Exception handling with EXECUTE STATEMENT
22 CS 1240 1188 764 1178 739 681 924 1439 1246 690 719 714 693 1578 1368 1199 1096 1222 1304 815 1202 894 1415 768 1443 1458 1319 1307 1260 1320
Case-sensitive character class names in SIMILAR TO
23 CS 1055 1053 613 1107 674 558 1216 1105 1044 566 651 583 641 1078 1164 1072 952 1018 1093 1049 1091 719 1111 634 964 1062 1053 1005 1129 1277
count(*) from big table returns negative result
24 CS 1015 1024 524 1031 667 626 1178 1187 1003 592 600 582 547 1065 1181 947 887 989 1101 934 812 684 1106 590 1020 1033 1067 1020 1008 1312
Incorrect ROW_COUNT value after SINGULAR condition
25 SS 592 555 582 353 342 330 348 683 436 363 355 524 343 636 310 611 382 370 348 668 506 470 507 439 445 463 438 490 472 471
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
26 SS X X X X X X X X X X X X X 1965 1962 1304 1250 2396 1204 1149 1160 1790 1981 1772 1677 2209 2435 2268 2482 2177
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
27 CS X X X X X X X X X X X X X 1464 643 1328 669 1248 751 1428 725 706 751 704 1484 1209 843 1321 912 1264
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
28 CS X X X X X X X X X X X X X 1085 604 1101 638 1210 589 611 623 741 1124 657 1083 1093 672 683 632 1055
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
29 CS X X X X X X X X X X X X X 1844 1776 1132 1043 2343 1183 1206 1052 1712 1733 1168 1947 2411 1126 1025 1104 2170
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
30 CS X X X X X X X X X X X X X 1191 667 1313 683 1591 755 1344 858 888 702 717 742 1350 740 676 1200 1455
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
31 SS 540 554 578 295 355 331 425 536 444 477 572 564 325 492 554 554 551 662 666 757 577 465 360 396 575 516 643 562 558 578
Segmentation fault when running query with partition by and subquery
32 CS X X X X X X X X X X X X X 1294 1307 689 774 1168 772 1411 760 910 758 1431 1363 877 1604 744 1344 789
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
33 CS X X X X X X X X X X X X X 1388 874 817 1529 1464 913 855 852 888 1421 995 1363 1351 804 1432 827 1396
Check correct work fix with foreign key
34 CS X X X X X X X X X X X X X 1223 775 725 1449 1574 769 1244 1217 823 1192 758 747 743 1320 1332 701 725
Zero divide in SP can crash database when call this SP several times
35 SS 432 263 416 194 416 210 429 276 224 529 445 268 283 231 263 355 384 421 497 421 380 301 336 461 401 394 190 416 255 453
crash on assert or memory corruption when too long username is used for authentication

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1828
http://tracker.firebirdsql.org/browse/CORE-1907
http://tracker.firebirdsql.org/browse/CORE-1971
http://tracker.firebirdsql.org/browse/CORE-1992
http://tracker.firebirdsql.org/browse/CORE-2001
http://tracker.firebirdsql.org/browse/CORE-2036
http://tracker.firebirdsql.org/browse/CORE-2038
http://tracker.firebirdsql.org/browse/CORE-2039
http://tracker.firebirdsql.org/browse/CORE-2041
http://tracker.firebirdsql.org/browse/CORE-2051
http://tracker.firebirdsql.org/browse/CORE-2061
http://tracker.firebirdsql.org/browse/CORE-2067
http://tracker.firebirdsql.org/browse/CORE-2140
http://tracker.firebirdsql.org/browse/CORE-2783
http://tracker.firebirdsql.org/browse/CORE-2804
http://tracker.firebirdsql.org/browse/CORE-2831
http://tracker.firebirdsql.org/browse/CORE-2833
http://tracker.firebirdsql.org/browse/CORE-2861
http://tracker.firebirdsql.org/browse/CORE-2871
http://tracker.firebirdsql.org/browse/CORE-2875
http://tracker.firebirdsql.org/browse/CORE-2907
http://tracker.firebirdsql.org/browse/CORE-2952
http://tracker.firebirdsql.org/browse/CORE-2957
http://tracker.firebirdsql.org/browse/CORE-2965
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_avoid_index_usage.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_insert_pk_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_division_by_zero_corrupts_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_crash_when_too_long_username_for_auth.py
https://github.com/FirebirdSQL/firebird/issues/6681
https://github.com/FirebirdSQL/firebird/issues/7744
https://github.com/FirebirdSQL/firebird/issues/7899
https://github.com/FirebirdSQL/firebird/issues/7962
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8290
https://github.com/FirebirdSQL/firebird/issues/8437
=== end of list ===

Last commits information (all timestamps in UTC):