01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (22 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (70 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (13 rows)
11. All tests: outcomes for previous 30 runs (2646 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 31.03.2025 00:44
Tested: FB60.   Build / date: 6.0.0.707-4bd4f5f0 / 2025.03.28;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.707
2025.03.28
4bd4f
6.0.0.698
2025.03.26
d72a7
6.0.0.693
2025.03.24
0b559
6.0.0.687
2025.03.22
730aa
6.0.0.686
2025.03.20
71bf6
6.0.0.685
2025.03.19
a8577
6.0.0.680
2025.03.18
90d29
6.0.0.677
2025.03.16
c0a60
6.0.0.676
2025.03.15
3034f
6.0.0.673
2025.03.13
40f5b
6.0.0.671
2025.03.12
a4fff
6.0.0.663
2025.03.11
daad2
6.0.0.661
2025.03.07
b9869
6.0.0.660
2025.03.04
a6700
6.0.0.658
2025.03.03
f15f8
6.0.0.656
2025.02.27
25fb4
6.0.0.655
2025.02.25
6e3e0
6.0.0.654
2025.02.24
b7141
6.0.0.652
2025.02.22
22662
6.0.0.647
2025.02.21
9fccb
6.0.0.640
2025.02.19
9b8ac
6.0.0.639
2025.02.18
201a4
6.0.0.637
2025.02.12
6d0f5
6.0.0.636
2025.02.11
0424f
6.0.0.635
2025.02.10
f640f
6.0.0.629
2025.02.07
194f9
Test TITLE
1
bugs core 0389 
 tracker
 CS 2022.02.02 14:46
1278 815 812 812 812 815 1006 1035 1035 1035 1068 1068 946 1041 1041 940 940 1027 1027 1032 1046 1046 1046 1000 991 850
NULLS FIRST does not work with unions
2
bugs core 0888 
 tracker
 CS 2022.02.02 14:46
979 640 640 640 720 745 745 1055 1042 1042 1042 1123 1123 1123 1123 1085 1085 1003 1003 1047 1049 1049 1049 1047 963 959
DDL - object in use
3
bugs core 0896 
 tracker
 CS 2022.02.02 14:46
1022 676 676 676 927 1009 1337 1337 1298 1298 1298 1295 1288 1288 1288 1255 1288 1304 1285 1304 1508 1464 1464 1464 1336 1244
SUBSTRING with NULL offset or length don't return NULL
4
bugs core 1089 
 tracker
 CS 2022.02.02 14:46
1141 714 714 838 894 894 894 1248 1375 1375 1325 1325 1325 1187 1171 1171 1299 1299 1299 1344 1344 1332 1314 1314 1263 1263
Wrong ordering with views, distinct, left join and order by
5
bugs core 3244 
 tracker
 CS 2022.02.02 14:46
1005 615 615 615 760 813 1093 1093 1046 1046 1046 1046 1048 1109 1109 1109 1079 1037 1037 1037 1007 1007 1102 1007 1007 642
POSITION: Wrong result with '' if third argument present
6
bugs core 3245 
 tracker
 CS 2022.02.02 14:46
1014 668 668 668 934 1016 1302 1391 1302 1302 1302 1333 1333 1333 1333 1328 1327 1327 1327 1330 1395 1395 1395 1383 1280 920
SUBSTRING on long blobs truncates result to 32767 if third argument not present
7
bugs core 3545 
 tracker
 CS 2022.02.02 14:46
1141 727 720 708 708 681 681 756 945 1061 1061 1061 1061 1129 1129 1129 1046 1046 1046 1086 1086 1102 1086 1042 1042 908
Inconsistent domain's constraint validation in PSQL
8
bugs core 3617 
 tracker
 CS 2022.02.02 14:46
1139 721 707 698 707 707 778 1108 1108 1133 1133 1052 1052 1134 1052 706 1078 1078 1054 1078 1078 1109 1054 1115 1069 1069
Window Function: cume_dist()
9
bugs core 3618 
 tracker
 CS 2022.02.02 14:46
1041 688 688 688 802 978 980 1312 1312 1364 1389 1364 1364 1389 1389 915 1479 1308 1308 1519 1519 1461 1461 1461 1405 1260
Window Function: ntile(num_buckets integer)
10
bugs core 3625 
 tracker
 CS 2022.02.02 14:46
1310 857 800 800 800 804 955 1077 1077 1077 1077 1076 1066 1076 1066 821 1039 964 964 1039 1099 1108 1108 1129 1129 1047
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
11
bugs core 3639 
 tracker
 CS 2022.02.02 14:46
1486 940 940 940 959 959 960 1527 1354 1456 1456 1456 1456 1456 1325 1481 1481 1481 1487 1487 1487 1448 1441 1441 1275 1186
Allow the use of multiple WHEN MATCHED / NOT MATCHED clauses in MERGE, as per the SQL 2008 specification
12
bugs core 4898 
 tracker
 CS 2022.02.02 14:46
1029 672 672 866 866 866 1396 1396 1391 1391 1391 1367 1344 1367 1367 1351 1344 1313 1313 1351 1372 1372 1372 1353 1301 825
Speed up function creation and loading when there are many functions in the database
13
bugs core 4905 
 tracker
 CS 2022.02.02 14:46
932 612 612 752 752 752 1089 1089 1058 1089 1089 1099 1124 1156 1156 1211 1211 1211 1124 1154 1124 1118 1124 1118 1084 647
Invalid internal BLR filter conversion
14
bugs core 4909 
 tracker
 CS 2022.02.02 14:46
1105 682 682 691 768 768 1044 1046 1044 1044 1044 1046 1068 1174 1174 1174 1166 1149 1089 1089 1089 1087 1089 1087 1087 669
MERGE / HASH JOINs produce incorrect results when VARCHAR join keys differ only by trailing spaces
15
bugs core 4917 
 tracker
 CS 2022.02.02 14:46
1107 661 661 899 1144 1158 1412 1412 1343 1343 1323 1317 1317 1317 1297 1336 1376 1376 1376 1376 1376 1385 1416 1416 1416 966
ALTER DOMAIN ... TO <new_name> allows to specify <new_name> matching to 'RDB$[[:DIGIT:]]*'
16
bugs gh 6941 
 tracker
 CS 2023.02.20 13:37
2252 X X X 1111 1028 1028 1111 1028 1028 977 977 830 977 977 830 830 761 660 660 660 660 1103 1106 1106 1106
Dummy (always true) conditions may change the join order
17
bugs gh 6941 
 tracker
 SS 2023.02.20 13:37
1640 X X X 614 432 432 535 432 501 501 501 437 501 518 523 518 518 521 521 521 521 521 399 328 328
Dummy (always true) conditions may change the join order
18
bugs gh 8115 
 tracker
 CS 2025.03.27 11:49
1340 883 X X 746 729 729 746 762 1000 1000 872 1000 872 724 630 630 613 630 630 646 646 673 1056 1056 1056
Avoid reading/hashing the inner stream(s) if the leader stream is empty
19
functional dml join 01 
 SS 2022.02.04 18:05
699 461 568 648 581 581 586 586 581 586 586 552 655 655 561 561 611 561 611 667 705 705 705 705 705 581
NAMED COLUMNS join
20
functional syspriv use gbak utility 
 SS 2022.10.07 17:51
1711 1112 1093 1009 999 934 767 934 844 934 876 952 920 952 920 995 920 872 872 872 819 872 899 899 899 899
Check ability to to make database backup
21
functional syspriv use granted by clause 
 SS 2022.02.04 18:05
842 555 555 555 1312 1427 1530 1590 1590 1702 1702 1702 1666 1666 1608 1564 1555 1555 1555 1620 1696 1696 1696 1693 1671 1582
Check ability to query, modify and deleting data plus add/drop constraints on any table
22
functional tabloid dbp 1940 20130912 1908 
 SS 2022.02.04 18:05
1806 1140 1119 1119 774 745 743 536 743 662 662 722 796 796 796 796 796 866 866 870 880 1027 1027 1027 1027 978
Common SQL. Check correctness of the results

Elapsed time, milliseconds:

NN Test name mode
6.0.0.707
2025.03.28
4bd4f
6.0.0.698
2025.03.26
d72a7
6.0.0.693
2025.03.24
0b559
6.0.0.687
2025.03.22
730aa
6.0.0.686
2025.03.20
71bf6
6.0.0.685
2025.03.19
a8577
6.0.0.680
2025.03.18
90d29
6.0.0.677
2025.03.16
c0a60
6.0.0.676
2025.03.15
3034f
6.0.0.673
2025.03.13
40f5b
6.0.0.671
2025.03.12
a4fff
6.0.0.663
2025.03.11
daad2
6.0.0.661
2025.03.07
b9869
6.0.0.660
2025.03.04
a6700
6.0.0.658
2025.03.03
f15f8
6.0.0.656
2025.02.27
25fb4
6.0.0.655
2025.02.25
6e3e0
6.0.0.654
2025.02.24
b7141
6.0.0.652
2025.02.22
22662
6.0.0.647
2025.02.21
9fccb
6.0.0.640
2025.02.19
9b8ac
6.0.0.639
2025.02.18
201a4
6.0.0.637
2025.02.12
6d0f5
6.0.0.636
2025.02.11
0424f
6.0.0.635
2025.02.10
f640f
6.0.0.629
2025.02.07
194f9
6.0.0.628
2025.02.06
859d5
6.0.0.621
2025.02.05
34fe7
6.0.0.609
2025.02.04
76d57
6.0.0.607
2025.02.03
1985b
Test TITLE
1
bugs core 0389 
 tracker
 CS 1278 1337 1320 793 812 815 743 1006 671 1035 1133 1083 900 946 1068 1101 930 1041 653 940 1032 1027 1170 1046 1085 1000 850 991 492 576
NULLS FIRST does not work with unions
2
bugs core 0888 
 tracker
 CS 1014 1208 979 640 566 621 720 1055 745 1089 608 1164 1042 1007 1123 1155 1125 1085 661 997 1121 1003 1088 1047 1049 1182 963 959 579 638
DDL - object in use
3
bugs core 0896 
 tracker
 CS 1068 1146 1022 657 663 676 927 1352 1009 1337 1422 1295 1298 1196 1351 1255 1288 1432 956 839 1535 1304 1285 1515 1508 1464 1244 1336 832 1039
SUBSTRING with NULL offset or length don't return NULL
4
bugs core 1089 
 tracker
 CS 1211 1141 714 682 1263 693 838 1248 894 1445 869 1375 1384 1325 1187 895 1389 1171 923 1299 1399 1344 1264 1433 1314 1332 834 708 1263 1328
Wrong ordering with views, distinct, left join and order by
5
bugs core 3244 
 tracker
 CS 1068 1005 1115 613 615 608 760 1129 813 1093 1168 1046 1030 985 1048 1166 1166 1109 710 1037 1079 982 1210 997 1007 1102 1157 628 642 599
POSITION: Wrong result with '' if third argument present
6
bugs core 3245 
 tracker
 CS 1014 1081 1083 600 660 668 1016 1391 934 1534 1302 1404 1302 1258 1333 1586 1489 1328 924 1327 1275 1330 1549 1455 1395 1383 1280 920 792 719
SUBSTRING on long blobs truncates result to 32767 if third argument not present
7
bugs core 3545 
 tracker
 CS 1147 1141 1213 720 708 727 681 640 756 627 1118 1128 945 1061 955 1276 1180 1129 694 1046 988 1149 1086 1117 1042 1102 665 670 1079 908
Inconsistent domain's constraint validation in PSQL
8
bugs core 3617 
 tracker
 CS 1139 1213 1188 688 721 698 707 639 778 1108 1149 1133 1004 1213 1052 643 1188 1134 706 668 1078 1109 1054 1191 1048 1115 626 1162 1069 911
Window Function: cume_dist()
9
bugs core 3618 
 tracker
 CS 1041 1197 1167 659 688 651 978 802 980 1312 1486 1396 1301 1364 1389 915 1508 1479 881 851 1551 1308 1519 1552 1461 1405 802 1472 1260 1031
Window Function: ntile(num_buckets integer)
10
bugs core 3625 
 tracker
 CS 1372 1467 1310 857 800 779 675 955 804 1127 1340 1077 1034 1076 1145 821 1066 1151 695 623 1039 964 1108 1099 1143 1136 626 1129 1047 893
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
11
bugs core 3639 
 tracker
 CS 1486 1783 1573 933 940 925 960 1550 959 857 1596 1527 1354 1456 1305 1521 1551 1325 1069 1481 1597 1487 1539 1448 1275 1441 920 1484 1186 1095
Allow the use of multiple WHEN MATCHED / NOT MATCHED clauses in MERGE, as per the SQL 2008 specification
12
bugs core 4898 
 tracker
 CS 1029 1361 592 672 1148 658 866 1457 819 1443 1396 1391 1208 1104 1404 1367 1344 1368 935 1351 1271 1313 1592 1407 1372 1353 1301 746 825 717
Speed up function creation and loading when there are many functions in the database
13
bugs core 4905 
 tracker
 CS 932 1059 612 599 1175 591 752 1227 724 1279 1089 1058 983 1124 1099 1457 1156 1228 771 1211 1314 1063 1124 1154 1118 1084 1182 601 638 647
Invalid internal BLR filter conversion
14
bugs core 4909 
 tracker
 CS 1152 1232 616 657 1105 682 691 1148 768 1164 1044 1046 1014 1031 1068 1191 1184 1174 752 1149 1166 996 1089 1070 1099 1087 1104 566 669 552
MERGE / HASH JOINs produce incorrect results when VARCHAR join keys differ only by trailing spaces
15
bugs core 4917 
 tracker
 CS 1107 1206 567 661 1144 550 899 1412 1158 1547 1451 1323 1343 1317 1297 1257 1336 1402 990 1480 1376 1305 1385 1342 1456 1416 1455 722 966 790
ALTER DOMAIN ... TO <new_name> allows to specify <new_name> matching to 'RDB$[[:DIGIT:]]*'
16
bugs gh 6941 
 tracker
 CS 2252 X X X 3089 3959 660 1111 785 1028 1126 1189 554 672 977 1405 830 1107 761 628 1118 660 614 1103 633 1106 1164 1153 596 566
Dummy (always true) conditions may change the join order
17
bugs gh 6941 
 tracker
 SS 1640 X X X 3286 3107 421 614 392 432 564 535 313 501 328 721 437 518 523 587 304 324 521 546 543 399 322 328 297 621
Dummy (always true) conditions may change the join order
18
bugs gh 8115 
 tracker
 CS 1745 883 X X 1340 1451 726 729 746 642 1014 762 1000 1024 872 627 1016 599 724 630 613 583 673 646 1063 556 1439 1056 567 1058
Avoid reading/hashing the inner stream(s) if the leader stream is empty
19
functional dml join 01 
 SS 709 417 461 738 699 433 568 648 581 732 586 552 527 740 655 431 751 561 529 667 611 546 755 797 705 705 461 934 581 398
NAMED COLUMNS join
20
functional syspriv use gbak utility 
 SS 1711 1870 1955 1093 1009 1112 700 999 767 934 742 985 844 952 876 1020 920 995 688 999 486 872 1051 812 819 924 899 914 561 609
Check ability to to make database backup
21
functional syspriv use granted by clause 
 SS 842 1011 903 524 555 552 1312 1530 1427 1590 1774 1784 1385 1702 1608 1821 1666 1564 1376 1555 1005 1620 1714 1696 1740 1693 1582 1671 952 1098
Check ability to query, modify and deleting data plus add/drop constraints on any table
22
functional tabloid dbp 1940 20130912 1908 
 SS 1996 1140 943 2018 1806 1119 745 525 774 743 479 536 804 662 722 903 796 954 745 553 880 866 1052 870 1027 1104 978 1217 813 955
Common SQL. Check correctness of the results

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1089
http://tracker.firebirdsql.org/browse/CORE-3244
http://tracker.firebirdsql.org/browse/CORE-3245
http://tracker.firebirdsql.org/browse/CORE-3545
http://tracker.firebirdsql.org/browse/CORE-3617
http://tracker.firebirdsql.org/browse/CORE-3618
http://tracker.firebirdsql.org/browse/CORE-3625
http://tracker.firebirdsql.org/browse/CORE-3639
http://tracker.firebirdsql.org/browse/CORE-389
http://tracker.firebirdsql.org/browse/CORE-4898
http://tracker.firebirdsql.org/browse/CORE-4905
http://tracker.firebirdsql.org/browse/CORE-4909
http://tracker.firebirdsql.org/browse/CORE-4917
http://tracker.firebirdsql.org/browse/CORE-888
http://tracker.firebirdsql.org/browse/CORE-896
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/dml/join/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_use_gbak_utility.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_use_granted_by_clause.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_dbp_1940_20130912_1908.py
https://github.com/FirebirdSQL/firebird/issues/6941
https://github.com/FirebirdSQL/firebird/issues/8115
=== end of list ===

Last commits information (all timestamps in UTC):