01. Total results for each kind of outcome and server mode, for previous 35 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (27 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 35 runs (51 rows)
08. Has runtime errors: tests with at least one runtime error for previous 35 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 35 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 35 runs (2985 rows)
12. Skipped: tests which was intentionally excluded from execution (174 rows)

Generated UTC 14.12.2025 01:24
Tested: FB60.   Build / date: 6.0.0.1372-27342188 / 2025.12.13;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 2.0.2; firebird.Qa: 0.21.0 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.1372
2025.12.13
6.0.0.1369
2025.12.12
6.0.0.1367
2025.12.10
6.0.0.1366
2025.12.08
6.0.0.1365
2025.12.07
6.0.0.1364
2025.12.04
6.0.0.1363
2025.12.03
6.0.0.1361
2025.12.01
6.0.0.1360
2025.11.29
6.0.0.1358
2025.11.24
6.0.0.1357
2025.11.19
6.0.0.1356
2025.11.17
6.0.0.1355
2025.11.16
6.0.0.1354
2025.11.09
6.0.0.1352
2025.11.08
6.0.0.1351
2025.11.07
6.0.0.1346
2025.11.06
6.0.0.1342
2025.11.05
6.0.0.1338
2025.11.03
6.0.0.1337
2025.11.01
6.0.0.1336
2025.10.31
6.0.0.1335
2025.10.29
6.0.0.1334
2025.10.27
6.0.0.1330
2025.10.26
6.0.0.1315
2025.10.24
6.0.0.1313
2025.10.21
6.0.0.1312
2025.10.17
6.0.0.1311
2025.10.16
6.0.0.1309
2025.10.15
6.0.0.1306
2025.10.13
6.0.0.1305
2025.10.12
Test TITLE
1 CS 2022.02.02 14:46
1091 722 722 701 701 701 701 701 957 1145 1167 1167 1145 1145 1167 1193 1193 1193 1216 1174 1054 1084 1084 1054 952 952 666 657 657 657 657
CREATE USER command: Invalid error message
2 CS 2022.02.02 14:46
1279 844 786 760 760 786 752 869 918 869 885 885 819 809 813 795 813 804 813 804 804 804 824 798 803 803 757 757 799 757 797
CREATE SEQUENCE START WITH has wrong initial value
3 CS 2022.02.02 14:46
1369 798 798 798 798 947 947 947 1237 947 857 857 843 805 801 801 801 861 862 862 862 854 854 849 849 849 847 847 847 796 816
Creating of the large procedure crashes the server
4 CS 2022.02.02 14:46
1082 709 651 703 703 703 762 961 1194 961 762 659 659 657 657 674 731 712 717 717 717 717 717 675 675 657 646 646 648 648 658
Problem with casting within UNION
5 CS 2022.02.02 14:46
1050 679 674 679 679 724 778 790 1046 790 790 704 704 704 695 747 752 747 705 705 684 684 704 673 704 704 684 643 684 684 671
"SIMILAR TO" hangs when processing parenthesis
6 CS 2022.02.02 14:46
1114 726 726 726 726 745 745 926 1021 926 724 701 701 701 704 707 726 707 717 734 734 733 733 734 736 733 701 725 725 715 715
BLOBs are unnecessarily copied during UPDATE after a table format change
7 CS 2022.02.02 14:46
1031 679 661 661 656 656 638 696 773 773 723 723 706 692 684 692 664 664 765 765 697 765 708 697 687 687 687 674 674 674 678
substring similar - extra characters in the result for non latin characters
8 CS 2022.08.08 18:02
2180 1451 1451 1419 1386 1386 1419 1539 1539 1539 1498 1483 1483 1412 1284 1284 1322 1322 1439 1482 1526 1531 1531 1531 1531 1528 1528 1301 1781 1412 1781
CREATE DATABASE grant is lost in security.db after backup/restore cycle
9 CS 2025.07.03 12:52
3189 2049 3189 3189 3109 2306 2306 2240 2240 2240 2228 2240 2228 2822 2822 3094 3094 3358 3358 3213 2751 2106 2106 2106 2082 3225 3225 2026 2005 2005 1909
User without ALTER ANY ROLE privilege can use COMMENT ON ROLE
10 CS 2022.02.02 14:46
1154 763 1129 1129 763 763 794 739 759 794 794 759 759 695 694 694 687 695 682 771 713 713 713 771 713 736 736 684 684 712 666
Provide same results for date arithmetics when date is changed by values near +/-max(bigint)
11 CS 2025.07.04 11:21
1340 880 1340 1340 876 876 930 930 955 955 955 894 828 800 828 804 804 880 1002 880 880 880 816 816 884 884 772 884 779 779 887
Indexed reads in a compound index with NULLs present even if record does not exist
12 CS 2025.07.25 08:47
1344 818 1403 1403 856 780 856 856 1100 1100 1100 921 865 810 865 790 790 795 1290 859 859 795 800 800 800 826 826 855 826 818 818
Optimizer fails applying stream-local predicates before merging [CORE2832]
13 CS 2025.07.04 13:09
1168 778 1123 1123 778 754 754 754 807 807 807 681 681 681 706 760 762 775 775 775 775 727 703 727 702 660 663 702 702 715 715
Query with SP doesn't accept explicit plan [CORE3451]
14 CS 2022.02.02 14:46
1164 750 1255 1255 750 750 776 776 776 776 758 718 680 680 681 681 707 707 707 707 721 705 704 721 696 696 696 965 786 884 786
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode
15 CS 2025.07.26 09:55
1238 775 1238 1238 880 828 880 880 880 882 922 891 882 891 891 878 878 878 815 878 856 815 792 856 820 820 820 1256 1256 1256 953
Sub-optimal predicate checking while selecting from a view [CORE3981]
16 CS 2023.02.16 08:11
3872 2400 3872 3872 2712 2400 2583 2583 2712 2583 2583 2490 2393 2393 2438 2436 2438 2486 2486 2533 2533 2486 2349 2300 2300 2300 2300 2323 2519 2519 2497
Grant and Revoke update (field) [CORE4407]
17 CS 2025.07.26 09:53
1369 868 1494 1494 822 822 843 843 855 958 958 958 902 902 884 902 1022 1022 906 1022 911 906 862 911 862 862 826 824 824 853 780
subselect losing the index when where clause includes coalesce() [CORE4640]
18 CS 2025.07.04 13:39
1331 799 1258 1258 799 799 841 841 875 875 856 856 856 856 810 823 902 823 788 823 779 755 742 755 742 742 763 1012 931 931 865
Index and blob garbage collection doesn't take into accout data in undo log [CORE4701]
19 CS 2024.07.22 17:38
2580 1687 2580 2836 2580 1764 1928 1928 1867 1928 1928 1867 1867 1780 1780 1793 1932 1895 1895 1895 1895 1826 1767 1767 1753 1753 1641 1757 1701 1757 1701
Support auth_plugin_list dpb/spb item from application to client [CORE5860]
20 CS 2025.07.04 20:30
1265 780 780 780 717 893 893 867 867 1284 1243 1243 1243 1243 722 716 722 735 735 735 735 735 766 833 1081 1185 1185 1081 969 794 794
Chained JOIN .. USING across the same column names may be optimized badly
21 CS 2025.07.26 09:52
2601 1677 1677 1677 1677 1683 1691 2057 2057 2057 2057 2057 2026 2026 2026 1763 1763 1763 1763 1906 1906 1935 1935 2352 2579 2803 2579 2579 2579 2230 2230
Optimizer regression: bad plan (HASH instead of JOIN) is chosen for some inner joins
22 CS 2023.12.14 16:44
1031 670 670 1031 1114 1114 1114 1125 1097 820 820 820 765 668 668 699 699 699 753 753 753 681 681 666 666 666 667 689 1036 1036 689
Result of blob_append(null, null) (literal '<null>') is not shown
23 CS 2023.03.10 21:40
1613 1030 1030 973 973 1223 1229 1229 1229 2057 2057 1682 1209 1209 1209 1133 1133 1087 1236 1236 1236 1072 1236 1286 1025 1025 1025 1025 1025 1104 1104
Precision of standalone unit may differ from packaged one in SQL dialect 1
24 SS 2023.10.04 10:35
620 399 399 362 347 347 573 626 638 638 665 665 665 579 604 579 490 449 449 449 718 718 718 620 368 368 620 368 661 661 403
CASE statement different result compared to FB 2.5.9
25 SS 2025.07.08 05:41
568 347 568 347 317 347 541 541 541 645 652 645 625 625 518 518 549 549 574 605 574 574 493 346 341 341 341 331 331 346 339
Regression: Error in isc_array_lookup_bounds
26 SS 2025.07.05 19:18
2498 1644 1644 1439 1411 1644 2530 2530 2849 2849 2605 2804 2605 2605 2700 2700 2571 2571 2415 2415 2415 2415 2419 2419 1337 1337 2261 1337 2261 2261 2144
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
27 SS 2025.07.08 12:50
731 476 738 508 476 508 751 742 756 756 747 742 747 721 747 721 721 708 708 708 708 708 696 462 462 616 557 557 616 557 557
ORDER BY ASC using index (multi)

Elapsed time, milliseconds:

NN Test name mode
6.0.0.1372
2025.12.13
6.0.0.1369
2025.12.12
6.0.0.1367
2025.12.10
6.0.0.1366
2025.12.08
6.0.0.1365
2025.12.07
6.0.0.1364
2025.12.04
6.0.0.1363
2025.12.03
6.0.0.1361
2025.12.01
6.0.0.1360
2025.11.29
6.0.0.1358
2025.11.24
6.0.0.1357
2025.11.19
6.0.0.1356
2025.11.17
6.0.0.1355
2025.11.16
6.0.0.1354
2025.11.09
6.0.0.1352
2025.11.08
6.0.0.1351
2025.11.07
6.0.0.1346
2025.11.06
6.0.0.1342
2025.11.05
6.0.0.1338
2025.11.03
6.0.0.1337
2025.11.01
6.0.0.1336
2025.10.31
6.0.0.1335
2025.10.29
6.0.0.1334
2025.10.27
6.0.0.1330
2025.10.26
6.0.0.1315
2025.10.24
6.0.0.1313
2025.10.21
6.0.0.1312
2025.10.17
6.0.0.1311
2025.10.16
6.0.0.1309
2025.10.15
6.0.0.1306
2025.10.13
6.0.0.1305
2025.10.12
6.0.0.1304
2025.10.11
6.0.0.1301
2025.10.10
6.0.0.1300
2025.10.08
6.0.0.1299
2025.10.07
Test TITLE
1 CS 1091 1143 1115 667 722 653 1026 701 634 957 653 1395 1433 1145 1167 749 1037 1193 1216 1257 696 665 1275 1174 1054 1084 952 666 654 1043 657 638 1250 644 1032
CREATE USER command: Invalid error message
2 CS 1279 1349 844 1620 760 786 752 712 1299 869 743 918 1416 809 885 770 819 753 813 795 813 804 824 798 764 838 824 754 803 692 757 799 803 738 797
CREATE SEQUENCE START WITH has wrong initial value
3 CS 1392 1369 786 1601 792 798 1084 792 1237 947 768 1268 1516 857 843 805 752 801 800 861 862 889 873 838 802 854 968 849 847 758 784 867 857 796 816
Creating of the large procedure crashes the server
4 CS 1129 1082 631 1274 709 636 651 703 1194 961 762 1385 1765 659 656 657 759 641 674 750 731 712 717 653 748 770 675 625 657 646 620 681 648 658 671
Problem with casting within UNION
5 CS 1050 1253 659 1238 679 674 642 724 1046 778 790 1111 1403 704 678 651 753 747 695 762 752 684 705 671 673 704 754 626 725 684 634 643 724 704 671
"SIMILAR TO" hangs when processing parenthesis
6 CS 1288 1114 656 1178 660 726 745 656 1071 926 724 1021 1356 701 639 677 726 707 704 804 747 707 717 734 736 733 699 738 767 701 675 725 820 715 711
BLOBs are unnecessarily copied during UPDATE after a table format change
7 CS 1148 679 1031 1172 661 656 638 696 626 1180 626 1308 773 723 684 706 692 662 661 767 664 765 817 697 665 1003 708 687 673 674 844 665 765 622 678
substring similar - extra characters in the result for non latin characters
8 CS 2469 1411 2180 2761 1451 1296 1419 1330 1386 1539 1550 1601 1498 1412 1483 1262 1509 1284 1270 1482 1322 1526 1439 2388 2221 1531 1528 1292 2168 1264 1908 1301 1781 1412 3016
CREATE DATABASE grant is lost in security.db after backup/restore cycle
9 CS 3203 1866 1963 3189 3256 2049 3422 1918 3109 2306 1937 2240 2059 3538 2228 2822 2010 3094 3358 3374 2751 3483 3213 2106 2082 2040 3379 3509 2026 3225 1857 1759 2005 3337 1909
User without ALTER ANY ROLE privilege can use COMMENT ON ROLE
10 CS 1154 694 634 1220 1252 763 1129 739 699 900 794 730 759 1244 1175 694 687 695 637 1198 663 1208 682 771 713 643 1146 1106 684 736 641 649 712 1206 666
Provide same results for date arithmetics when date is changed by values near +/-max(bigint)
11 CS 1492 765 880 1430 1340 839 1481 876 826 930 1693 992 955 800 894 828 752 777 1156 804 1002 880 1343 792 816 888 752 1381 884 772 703 1526 779 887 924
Indexed reads in a compound index with NULLs present even if record does not exist
12 CS 1344 782 818 1411 1403 733 1491 856 780 745 1611 1292 1100 810 921 865 785 774 1290 790 1397 795 1431 859 784 715 800 1375 826 855 818 1502 774 766 844
Optimizer fails applying stream-local predicates before merging [CORE2832]
13 CS 1322 732 692 1168 1290 778 1123 754 745 677 881 1489 807 671 681 645 706 762 1172 760 1369 775 703 780 727 628 608 1123 702 660 663 1331 715 966 694
Query with SP doesn't accept explicit plan [CORE3451]
14 CS 1164 675 733 1382 1255 750 1271 703 707 776 788 1383 758 680 718 660 654 681 909 707 1240 705 704 721 737 691 696 1212 640 965 690 1208 786 884 708
recreate table T with PK or UK is impossible after duplicate typing w/o commit when ISQL is launched in AUTODDL=OFF mode
15 CS 1239 754 764 1238 1567 775 1409 827 880 828 1472 1510 876 882 922 891 743 1094 815 878 1373 815 792 1059 856 787 752 1299 820 1256 751 1350 1542 953 843
Sub-optimal predicate checking while selecting from a view [CORE3981]
16 CS 4405 2265 2284 4165 3872 2400 4092 2296 2712 2380 2583 5611 2719 2393 2490 2370 2327 3790 2438 2436 4458 2486 2533 4520 2349 2275 2300 2283 2323 4305 2202 2519 2973 2497 2301
Grant and Revoke update (field) [CORE4407]
17 CS 1369 701 868 1541 1521 822 1494 816 809 855 843 1572 992 958 861 821 902 1482 884 1022 1539 906 789 1732 911 862 826 963 824 1617 780 732 853 985 767
subselect losing the index when where clause includes coalesce() [CORE4640]
18 CS 1331 799 758 1371 1400 799 1258 746 766 908 841 1745 875 856 810 745 902 1434 788 823 1430 779 708 1416 755 722 742 1339 727 1325 763 1012 931 865 781
Index and blob garbage collection doesn't take into accout data in undo log [CORE4701]
19 CS 2892 1572 1601 2836 2580 1687 3013 2916 1524 1764 1928 3093 1867 3217 1731 1712 2023 1780 1932 1793 3030 1895 1826 1962 1767 1753 1641 2596 1617 3051 1573 1757 1701 1822 1689
Support auth_plugin_list dpb/spb item from application to client [CORE5860]
20 CS 1267 1265 1390 780 717 636 893 1324 680 1439 759 867 1408 1284 1243 704 690 1286 722 716 785 735 735 766 687 833 1346 1281 1081 1185 969 698 794 730 1220
Chained JOIN .. USING across the same column names may be optimized badly
21 CS 2703 2601 2925 1574 1677 1595 1683 3044 1552 2928 1691 2057 3145 1890 2965 1740 2026 2790 1642 1763 1663 2708 1906 1935 1697 3012 2803 2352 2579 3789 2579 1758 2230 1737 2859
Optimizer regression: bad plan (HASH instead of JOIN) is chosen for some inner joins
22 CS 1161 1036 630 670 1031 580 1114 1181 1125 772 1097 1469 820 765 668 1444 657 666 1129 699 1108 679 753 1260 681 642 666 654 667 1175 689 1036 1175 685 601
Result of blob_append(null, null) (literal '<null>') is not shown
23 CS 1613 1639 1763 1030 973 935 1701 951 1223 1229 2319 2095 1084 2057 1209 1682 1133 1087 1804 1075 1788 1072 1236 1286 1015 950 1873 1667 1025 1012 993 1771 1845 1104 948
Precision of standalone unit may differ from packaged one in SQL dialect 1
24 SS 636 670 620 399 362 347 573 328 340 626 638 935 665 396 725 579 703 490 604 366 449 356 728 757 718 368 620 339 351 702 661 368 822 403 351
CASE statement different result compared to FB 2.5.9
25 SS 624 320 631 568 303 347 657 317 286 541 689 670 470 645 652 518 625 432 416 605 549 610 574 651 346 312 493 341 311 606 331 330 568 346 339
Regression: Error in isc_array_lookup_bounds
26 SS 2557 2498 2676 1439 1310 1644 2710 1338 1411 2849 2530 2912 2890 2605 2152 2804 2561 2700 2701 2571 2352 2415 2332 2419 2493 1294 2635 1337 1322 2261 2598 1324 2344 1528 2144
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
27 SS 731 407 864 738 401 476 751 508 436 756 924 742 862 657 747 441 804 721 854 430 639 708 846 844 385 696 407 462 616 867 557 428 698 400 602
ORDER BY ASC using index (multi)

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-2434
http://tracker.firebirdsql.org/browse/CORE-6084
http://tracker.firebirdsql.org/browse/CORE-6086
http://tracker.firebirdsql.org/browse/CORE-6087
http://tracker.firebirdsql.org/browse/CORE-6088
http://tracker.firebirdsql.org/browse/CORE-6089
http://tracker.firebirdsql.org/browse/CORE-6158
http://tracker.firebirdsql.org/browse/CORE-6208
http://tracker.firebirdsql.org/browse/CORE-6489
http://tracker.firebirdsql.org/browse/CORE-6504
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_13.py
https://github.com/FirebirdSQL/firebird/issues/3106
https://github.com/FirebirdSQL/firebird/issues/3218
https://github.com/FirebirdSQL/firebird/issues/3812
https://github.com/FirebirdSQL/firebird/issues/3886
https://github.com/FirebirdSQL/firebird/issues/4314
https://github.com/FirebirdSQL/firebird/issues/4729
https://github.com/FirebirdSQL/firebird/issues/4954
https://github.com/FirebirdSQL/firebird/issues/5009
https://github.com/FirebirdSQL/firebird/issues/6120
https://github.com/FirebirdSQL/firebird/issues/7118
https://github.com/FirebirdSQL/firebird/issues/7137
https://github.com/FirebirdSQL/firebird/issues/7482
https://github.com/FirebirdSQL/firebird/issues/7501
https://github.com/FirebirdSQL/firebird/issues/7600
https://github.com/FirebirdSQL/firebird/issues/7647
https://github.com/FirebirdSQL/firebird/issues/7744
=== end of list ===

Last commits information (all timestamps in UTC):