01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (1 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (33 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (34 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2617 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 28.01.2025 00:56
Tested: FB60.   Build / date: 6.0.0.600-188de600 / 2025.01.27;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.600
2025.01.27
6.0.0.599
2025.01.25
6.0.0.598
2025.01.23
6.0.0.595
2025.01.22
6.0.0.594
2025.01.21
6.0.0.590
2025.01.20
6.0.0.588
2025.01.19
6.0.0.587
2025.01.18
6.0.0.585
2025.01.16
6.0.0.584
2025.01.15
6.0.0.581
2025.01.14
6.0.0.577
2025.01.13
6.0.0.576
2025.01.12
6.0.0.573
2025.01.10
6.0.0.571
2024.12.31
6.0.0.570
2024.12.30
6.0.0.565
2024.12.28
6.0.0.564
2024.12.26
6.0.0.560
2024.12.25
6.0.0.559
2024.12.23
6.0.0.556
2024.12.22
6.0.0.555
2024.12.19
6.0.0.553
2024.12.17
6.0.0.552
2024.12.11
6.0.0.550
2024.12.10
6.0.0.548
2024.12.08
Test TITLE
1 CS 2022.02.02 14:46
1034 677 688 688 677 688 688 870 832 832 587 604 585 566 564 549 549 514 514 514 525 525 934 947 947 947
Multiple Rows in Singleton Select not reported in a View
2 CS 2022.02.02 14:46
991 653 739 991 739 739 1082 1085 1085 1087 1085 1085 903 548 530 530 548 550 550 678 550 550 678 808 887 887
Server crashes instead of reporting the error "key size exceeds implementation restriction"
3 CS 2022.02.02 14:46
1272 842 1272 1319 1272 1339 1339 892 833 811 811 811 734 811 953 701 855 855 855 684 855 684 1248 1226 1226 1185
Engine crashes when attempt to REcreate table with FK after syntax error before such recreating
4 CS 2022.02.02 14:46
1138 718 701 701 694 694 701 689 688 689 962 962 962 1077 1059 1077 1083 1083 1083 1083 1052 1030 1052 1036 1036 1072
ISQL issues warning: "Bad debug info format" when connect to database with stored function after it`s restoring
5 CS 2023.11.25 16:12
1021 626 619 619 597 619 668 668 624 715 878 878 878 961 1018 1018 990 990 990 975 975 1006 1006 1011 1012 1012
Changed data not visible in WHEN-section if exception occured inside SP that has been called from this code
6 CS 2023.10.09 08:57
1031 685 652 652 652 685 688 688 672 688 956 956 956 959 959 988 1013 1013 1029 1013 1013 1029 1041 1053 1053 1041
Description (COMMENT ON) for package procedures and functions, and its parameters
7 CS 2024.10.31 10:17
1064 693 693 693 693 1270 1270 1270 1113 1113 1094 1113 1094 1094 1128 1128 1081 1081 1081 1070 1081 1085 1085 1070 1124 1087
REPLACE function works incorrectly with multibyte charsets
8 CS 2022.02.02 14:46
1044 623 623 623 791 892 999 911 911 1134 984 984 984 1042 997 997 993 993 993 963 993 998 998 1037 1037 1072
ALTER DATABASE SET DEFAULT CHARACTER SET: 1) take effect only for once for current attachment; 2) does not check that new char set exists untill it will be used
9 CS 2024.10.31 10:17
1033 645 645 645 1004 1039 1039 1039 1039 1039 979 979 912 912 947 940 947 947 953 953 985 985 1010 1016 1016 1016
Position function does not consider the collation for blob
10 SS 2024.01.10 07:14
612 383 377 375 371 368 368 368 368 368 362 362 354 352 352 352 340 348 342 340 342 342 326 326 346 353
The ability to retrieve the total number of pages in the database
11 CS 2022.02.04 18:05
1309 815 1309 802 1309 1342 1342 905 905 829 741 715 715 715 715 719 719 688 688 688 662 662 1143 674 693 693
INNER JOIN join merge
12 CS 2022.04.08 11:16
1326 827 1267 1267 1267 1267 1327 1327 1202 954 735 733 691 691 691 684 684 684 684 684 715 739 1096 739 884 1096
INNER JOIN join merge and SP
13 CS 2022.02.04 18:05
1015 672 1015 1009 1015 1031 1036 1036 1036 829 647 575 539 539 539 585 585 585 585 576 554 576 942 576 562 942
LEFT OUTER JOIN with no match and IS NULL in WHERE clause
14 CS 2022.02.04 18:05
1388 868 1193 1193 1335 1335 1360 1360 1360 947 779 738 723 723 723 1088 1088 1088 1088 691 664 664 653 653 653 657
LEFT OUTER JOIN with full match, but limited in ON and WHERE clause
15 CS 2022.02.04 18:05
1375 802 1324 1324 1361 1327 1327 1327 1309 828 757 748 722 722 722 1106 1106 1106 1237 683 683 683 672 672 685 686
LEFT OUTER JOIN with full match, but limited in ON and WHERE clause
16 CS 2022.02.04 18:05
968 611 611 596 596 992 992 768 1033 1028 768 964 964 636 636 598 521 521 521 518 521 525 525 517 517 517
DECFLOAT should not throw exceptions when +/-NaN, +/-sNaN and +/-Infinity is used in comparisons
17 CS 2022.02.04 18:05
1249 761 835 835 835 835 835 940 940 940 756 940 753 682 682 682 678 662 678 662 662 647 646 646 646 653
UPDATE OR INSERT
18 CS 2022.02.04 18:05
1241 820 820 820 820 820 827 917 917 827 780 780 751 707 707 642 636 636 741 639 639 659 639 639 659 661
ALTER DOMAIN - SET DEFAULT
19 CS 2023.12.16 10:29
1255 749 1011 749 694 749 752 752 820 820 820 726 668 659 606 659 654 636 636 636 636 636 877 877 877 1109
Crash on attempt to GROUP BY on table with varchar(4000) field
20 CS 2023.12.16 10:31
1132 712 1132 712 643 662 662 662 662 710 710 710 627 606 574 606 574 574 574 559 559 612 1047 1047 1047 1008
Test the level 0 syntax for SQL create domain defining only the datatype
21 CS 2022.02.07 17:03
1247 771 1247 697 697 718 857 857 857 825 825 825 703 703 686 703 686 684 684 633 633 684 1118 1118 1118 1118
Test the level 0 syntax for SQL "CREATE DOMAIN" statement using datatype and CHECK constraint clause.
22 CS 2022.02.07 17:03
1123 712 1123 667 667 688 720 720 720 688 672 672 672 672 617 715 715 596 612 612 612 612 1096 1096 1096 1096
Test CREATE / ALTER domain statement with ADD/DROP CONSTRAINT clauses, together and separately.
23 CS 2023.11.25 21:42
2751 1812 1886 1886 1886 3218 3218 3265 3265 2980 2912 2980 2460 2129 2129 2254 1997 1697 2254 2254 1697 1697 1693 1693 1679 1693
Check ability of outer join simplification.
24 CS 2022.02.04 18:05
1289 819 819 759 921 903 903 876 903 903 876 910 910 910 1156 1157 1157 1157 814 674 674 671 678 678 678 666
ALTER TRIGGER - ACTIVE
25 CS 2022.02.04 18:05
1281 831 831 770 826 826 826 826 889 889 828 889 828 828 1172 1176 1172 1172 891 676 676 676 656 656 677 654
ALTER TRIGGER - BEFORE DELETE
26 CS 2022.02.04 18:05
1376 902 902 810 903 892 903 903 906 906 906 920 862 862 742 1129 742 742 742 682 682 694 694 694 694 665
ALTER TRIGGER - BEFORE INSERT
27 CS 2022.02.04 18:05
1344 826 826 786 879 879 879 879 882 887 882 887 887 887 695 1167 672 672 672 671 671 671 665 665 734 665
ALTER TRIGGER - AFTER DELETE
28 CS 2022.02.04 18:05
1336 885 871 885 923 908 915 915 915 915 915 964 964 964 1132 1132 1124 1124 1124 1124 1219 1219 1219 769 703 678
CREATE TRIGGER BEFORE INSERT DECLARE VARIABLE
29 CS 2022.02.04 18:05
1295 801 795 801 850 850 875 882 909 909 875 909 862 862 943 1186 943 943 1161 1161 1149 1149 1149 660 660 660
CREATE TRIGGER BEFORE INSERT DECLARE VARIABLE, block stataments
30 CS 2023.02.28 09:35
2471 1636 1533 1533 1743 1743 1743 1748 1877 1835 1748 1835 1835 1835 2018 2323 2332 2332 2346 2346 2346 2241 2241 1312 1312 1312
ON DISCONNECT trigger must fire during database shutdown (gfix -shut full -force 0).
31 SS 2023.12.28 07:19
691 452 452 450 438 438 568 560 560 560 560 557 532 532 532 532 581 581 608 581 638 639 639 657 657 657
gbak utility: check ability to use -ZIP command switch when create backup
32 SS 2022.02.04 18:05
703 442 442 442 442 442 602 590 590 602 609 609 609 609 583 569 569 569 569 656 656 620 620 620 602 599
CREATE VIEW
33 SS 2022.02.04 18:05
629 418 418 447 447 447 465 465 465 537 564 564 489 564 493 493 620 620 620 620 618 617 617 617 608 566
CREATE VIEW

Elapsed time, milliseconds:

NN Test name mode
6.0.0.600
2025.01.27
6.0.0.599
2025.01.25
6.0.0.598
2025.01.23
6.0.0.595
2025.01.22
6.0.0.594
2025.01.21
6.0.0.590
2025.01.20
6.0.0.588
2025.01.19
6.0.0.587
2025.01.18
6.0.0.585
2025.01.16
6.0.0.584
2025.01.15
6.0.0.581
2025.01.14
6.0.0.577
2025.01.13
6.0.0.576
2025.01.12
6.0.0.573
2025.01.10
6.0.0.571
2024.12.31
6.0.0.570
2024.12.30
6.0.0.565
2024.12.28
6.0.0.564
2024.12.26
6.0.0.560
2024.12.25
6.0.0.559
2024.12.23
6.0.0.556
2024.12.22
6.0.0.555
2024.12.19
6.0.0.553
2024.12.17
6.0.0.552
2024.12.11
6.0.0.550
2024.12.10
6.0.0.548
2024.12.08
6.0.0.544
2024.12.05
6.0.0.543
2024.12.03
6.0.0.540
2024.12.02
6.0.0.539
2024.11.28
Test TITLE
1 CS 1148 636 1034 1319 620 677 688 870 543 876 587 1114 832 566 585 604 549 564 500 488 947 514 525 490 934 1082 947 988 856 511
Multiple Rows in Singleton Select not reported in a View
2 CS 1180 584 653 1026 991 632 739 1219 616 1096 1082 1085 1087 1172 903 530 548 502 501 841 945 550 515 678 503 953 808 939 887 553
Server crashes instead of reporting the error "key size exceeds implementation restriction"
3 CS 1423 793 842 1319 1272 773 1425 1418 892 1339 786 833 734 811 1215 701 686 1052 953 667 855 684 1259 641 1310 667 1248 1226 1185 1143
Engine crashes when attempt to REcreate table with FK after syntax error before such recreating
4 CS 1138 1400 1146 718 650 694 701 780 688 667 1103 689 639 1154 962 1077 632 1124 1059 1120 1083 611 1155 1052 1013 1030 1072 1036 1095 1089
ISQL issues warning: "Bad debug info format" when connect to database with stored function after it`s restoring
5 CS 1204 1380 1021 626 572 588 619 668 597 715 1084 624 614 878 961 1018 595 1032 1034 990 954 548 1006 975 1012 1011 967 1069 1012 1015
Changed data not visible in WHEN-section if exception occured inside SP that has been called from this code
6 CS 1240 1418 1031 652 587 685 652 692 597 688 1052 672 610 978 956 959 656 988 1184 1071 1013 570 1029 982 1092 1041 1053 1069 1016 1028
Description (COMMENT ON) for package procedures and functions, and its parameters
7 CS 1247 1112 1064 604 627 693 1317 1270 660 1272 970 1277 1113 1080 1094 1128 597 1160 1131 1053 1081 607 1085 1070 1212 1143 1059 622 1124 1087
REPLACE function works incorrectly with multibyte charsets
8 CS 1044 1133 1126 611 586 623 999 892 791 1162 1134 911 897 1159 984 1047 545 1042 997 963 993 552 998 930 1037 1106 962 1098 670 1072
ALTER DATABASE SET DEFAULT CHARACTER SET: 1) take effect only for once for current attachment; 2) does not check that new char set exists untill it will be used
9 CS 1185 1033 1111 645 584 609 1074 1131 1004 1039 875 1296 1054 894 979 912 586 947 967 940 953 569 985 1060 1032 964 1010 1016 1111 1079
Position function does not consider the collation for blob
10 SS 703 660 377 612 375 383 350 371 345 368 376 362 511 354 336 404 333 352 389 332 340 348 342 326 346 311 315 361 353 371
The ability to retrieve the total number of pages in the database
11 CS 1456 815 1445 802 1309 802 1424 764 1396 1342 829 905 741 701 715 652 719 1138 661 730 688 662 1264 629 653 1143 1193 674 693 672
INNER JOIN join merge
12 CS 1456 785 1417 827 1326 814 1267 1388 1202 1333 1327 954 733 735 691 681 669 1187 707 684 678 675 1235 739 715 1259 1096 664 884 1208
INNER JOIN join merge and SP
13 CS 1119 672 1165 617 1015 561 1031 1009 1036 1106 1157 829 647 575 532 510 539 1060 911 585 488 548 1077 576 554 989 942 544 562 1049
LEFT OUTER JOIN with no match and IS NULL in WHERE clause
14 CS 1564 868 1488 745 1388 827 1193 1335 1428 1409 1360 947 779 738 633 627 723 1255 1279 1088 651 691 1314 664 646 631 653 657 664 1237
LEFT OUTER JOIN with full match, but limited in ON and WHERE clause
15 CS 1528 800 1407 753 1375 802 1324 1361 1364 1327 1309 828 748 757 680 667 722 1106 1237 1261 631 683 1267 672 685 649 611 686 710 953
LEFT OUTER JOIN with full match, but limited in ON and WHERE clause
16 CS 1108 1154 611 968 541 596 992 584 1033 1052 616 768 1067 1028 636 964 598 521 1010 496 518 521 1000 504 525 527 517 505 507 535
DECFLOAT should not throw exceptions when +/-NaN, +/-sNaN and +/-Infinity is used in comparisons
17 CS 1409 728 761 1249 1250 743 835 769 1322 963 756 940 753 1004 656 1159 682 640 1172 645 678 662 1202 647 646 613 645 675 684 653
UPDATE OR INSERT
18 CS 1503 808 820 1367 1241 820 777 793 917 1203 827 917 751 780 707 1212 642 633 917 630 636 741 1128 639 627 659 629 690 683 661
ALTER DOMAIN - SET DEFAULT
19 CS 1255 739 1291 1289 632 749 1011 694 636 752 1321 820 909 726 571 659 668 606 604 1121 654 636 607 624 877 1180 1109 589 628 1134
Crash on attempt to GROUP BY on table with varchar(4000) field
20 CS 1240 637 1208 1132 569 712 1193 643 634 662 1204 726 627 710 535 1050 606 524 574 1048 559 612 540 520 1053 1047 1048 550 604 1008
Test the level 0 syntax for SQL create domain defining only the datatype
21 CS 1585 771 1265 1247 697 676 1486 683 857 718 1444 893 684 825 637 1120 703 632 686 1187 631 684 628 633 1276 1118 1204 647 645 1284
Test the level 0 syntax for SQL "CREATE DOMAIN" statement using datatype and CHECK constraint clause.
22 CS 1275 712 1327 1123 667 651 1304 661 720 688 1268 752 650 672 617 841 715 574 575 1124 990 596 612 568 1104 1116 1096 627 584 1136
Test CREATE / ALTER domain statement with ADD/DROP CONSTRAINT clauses, together and separately.
23 CS 3584 1812 2751 3036 1807 1511 1886 3218 3373 3915 2912 3265 2980 2460 2129 3284 1997 1469 3484 2254 1419 1697 3381 2952 1679 1693 1541 1809 1592 2923
Check ability of outer join simplification.
24 CS 1424 1417 819 759 1289 751 1577 750 921 903 761 876 1256 910 623 1156 679 1157 1244 1207 674 661 814 671 1241 657 678 1204 666 659
ALTER TRIGGER - ACTIVE
25 CS 1403 1281 831 754 1357 770 1374 766 826 914 805 889 1304 828 628 1190 684 1172 1195 1176 623 676 891 656 1408 634 634 887 677 654
ALTER TRIGGER - BEFORE DELETE
26 CS 1488 1478 902 750 1376 772 1294 810 903 892 906 920 1309 862 625 1168 735 1129 742 1168 660 682 914 677 1203 694 637 1133 646 665
ALTER TRIGGER - BEFORE INSERT
27 CS 1355 1394 826 734 1344 765 1031 786 879 900 866 882 1289 887 695 1209 671 1167 672 1167 664 671 1192 610 1280 665 616 1128 734 658
ALTER TRIGGER - AFTER DELETE
28 CS 1336 1403 842 885 1396 871 759 952 923 908 915 844 1249 964 633 1218 676 1178 1132 1124 673 688 1256 1239 1219 769 615 642 703 678
CREATE TRIGGER BEFORE INSERT DECLARE VARIABLE
29 CS 1316 1295 773 801 1316 795 775 850 882 909 875 909 1319 862 680 1198 685 943 1228 1186 668 672 1161 1225 1149 647 659 660 682 688
CREATE TRIGGER BEFORE INSERT DECLARE VARIABLE, block stataments
30 CS 2888 2824 1636 1495 2471 1533 1383 1743 1877 1925 1700 1748 2567 1835 1286 2323 1330 2018 2507 2332 2370 1324 2346 2379 2241 1312 1220 1282 1319 1318
ON DISCONNECT trigger must fire during database shutdown (gfix -shut full -force 0).
31 SS 799 720 452 450 691 438 705 411 396 713 568 560 444 557 636 532 402 488 608 581 638 399 639 576 664 657 367 675 544 676
gbak utility: check ability to use -ZIP command switch when create backup
32 SS 788 756 421 403 703 442 723 436 416 602 667 590 400 646 609 652 426 583 548 569 683 410 656 658 602 620 409 656 449 599
CREATE VIEW
33 SS 636 787 409 408 629 418 948 447 445 465 537 689 458 564 688 489 400 644 493 620 645 366 657 617 618 608 378 619 539 566
CREATE VIEW

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1572
http://tracker.firebirdsql.org/browse/CORE-4127
http://tracker.firebirdsql.org/browse/CORE-4304
http://tracker.firebirdsql.org/browse/CORE-4480
http://tracker.firebirdsql.org/browse/CORE-4483
http://tracker.firebirdsql.org/browse/CORE-4484
http://tracker.firebirdsql.org/browse/CORE-4599
http://tracker.firebirdsql.org/browse/CORE-4744
http://tracker.firebirdsql.org/browse/CORE-5695
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_merge_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_inner_join_merge_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_left_join_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_left_join_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_left_join_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/datatypes/test_decfloat_nan_and_infinity_comparison.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/dml/update_or_insert/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_crash_of_group_by_varchar_4000.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_dsql_domain_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_dsql_domain_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_dsql_domain_07.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_join_transformation_006.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/alter/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/alter/test_03.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/alter/test_04.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/alter/test_06.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/create/test_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/create/test_10.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/database/test_disconnect_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/util/test_gbak_zip.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/view/create/test_02.py
https://github.com/FirebirdSQL/firebird/issues/7888
=== end of list ===

Last commits information (all timestamps in UTC):