01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (699 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (24 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (1874 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (78 rows)
11. All tests: outcomes for previous 30 runs (3633 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 05.07.2025 02:44
Tested: FB60.   Build / date: 6.0.0.909-1e2ef76f / 2025.07.04;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.909
2025.07.04
1e2ef
6.0.0.894
2025.07.03
789ba
6.0.0.892
2025.07.02
10f7d
6.0.0.889
2025.07.01
969ac
6.0.0.884
2025.06.30
f7e5f
6.0.0.881
2025.06.27
7035d
6.0.0.877
2025.06.26
8e38f
6.0.0.876
2025.06.25
b1bec
6.0.0.863
2025.06.24
c3c20
6.0.0.858
2025.06.23
8d6f7
6.0.0.849
2025.06.20
7b79c
6.0.0.848
2025.06.19
c483c
6.0.0.845
2025.06.18
22b12
6.0.0.843
2025.06.16
995f4
6.0.0.840
2025.06.14
29bca
6.0.0.838
2025.06.13
0e28a
6.0.0.835
2025.06.12
2cf29
6.0.0.834
2025.06.11
e889f
6.0.0.800
2025.06.10
1f226
6.0.0.799
2025.06.07
be644
6.0.0.797
2025.06.06
303e8
6.0.0.795
2025.05.29
7a71a
6.0.0.792
2025.05.28
b4327
6.0.0.791
2025.05.27
02db8
6.0.0.789
2025.05.21
64051
6.0.0.787
2025.05.20
230ad
Test TITLE
1
bugs core 1482 
 tracker
 CS 2025.06.25 15:44
1510 896 896 1300 1300 1460 1465 1596 X X X X X X X X X X 1598 1596 1596 1598 1533 1517 1454 1454
Make optimizer to consider ORDER BY optimization when making decision about join order
2
bugs core 1492 
 tracker
 CS 2022.02.02 14:46
1024 660 660 1024 1012 1020 1020 1012 656 656 656 696 696 696 1094 1061 1061 1119 1136 1205 1205 1136 1099 1096 1066 1002
BLOB isn't compatible with [VAR]CHAR in COALESCE
3
bugs core 1512 
 tracker
 CS 2022.02.02 14:46
1083 666 666 703 703 974 1075 1075 974 694 694 694 1028 1028 1113 1069 1069 1069 1127 1127 1127 1111 1111 1111 1111 1082
Connection lost running script
4
bugs core 1514 
 tracker
 CS 2022.02.02 14:46
1056 626 626 854 854 1041 1041 1041 921 638 638 638 980 980 1075 1046 1075 1062 1126 1163 1163 1076 1076 1049 1017 1017
Many new 2.1 built in functions have incorrect NULL semantics
5
bugs core 1522 
 tracker
 CS 2022.02.02 14:46
1043 680 655 680 680 758 919 919 758 594 594 594 871 871 871 871 871 968 1032 1109 1060 1060 1060 994 994 994
Inconsistent DATEDIFF behaviour
6
bugs core 1784 
 tracker
 CS 2022.02.02 14:46
1272 774 774 X X 774 774 783 785 785 785 785 1139 1139 1129 1129 1129 1129 881 1261 1352 1352 881 1352 1352 1381
Error with EXECUTE PROCEDURE inside EXECUTE STATEMENT
7
bugs core 1810 
 tracker
 CS 2022.02.02 14:46
1461 906 906 936 906 936 936 843 832 832 832 1005 1005 1360 1005 932 932 1470 1540 1641 1641 1549 1549 1549 1549 1574
Usernames with '.' character
8
bugs core 1811 
 tracker
 CS 2022.02.02 14:46
1241 779 764 779 764 779 812 812 795 812 816 795 790 837 790 790 807 837 1264 1317 1397 1397 1397 1282 1282 1282
Incorrect parser's reaction to the unquoted usage of the keyword "VALUE"
9
bugs core 2907 
 tracker
 CS 2022.02.02 14:46
1323 869 869 792 792 796 796 796 808 808 808 808 807 781 781 807 1261 1261 1261 1261 1191 1162 1162 1191 867 867
Exception handling with EXECUTE STATEMENT
10
bugs core 2969 
 tracker
 CS 2022.02.02 14:46
982 639 672 X X 639 672 639 646 646 667 667 667 880 880 1102 1074 1102 1136 1102 1170 1205 1170 948 1088 1088
rdb$set_context does NOT allow to overwrite any vars after encountering limit (default=1000) of them
11
bugs core 5070 
 tracker
 SS 2025.07.01 10:57
660 438 419 406 X X X X X X X X X X X X X X 406 419 454 454 454 435 424 424
Compound index cannot be used for filtering in some ORDER/GROUP BY queries
12
bugs core 5183 
 tracker
 SS 2022.02.02 14:46
600 394 394 365 365 365 369 369 395 555 555 555 574 582 574 574 417 408 404 408 408 404 431 431 432 419
Regression: line/column numbering may be twisted if alias.name syntax is used
13
bugs core 6356 
 tracker
 SS 2022.02.02 14:46
551 346 469 469 320 396 469 469 578 616 616 578 511 511 457 457 426 426 426 438 438 459 438 428 428 427
ROUND() does not allow second argument >=1 when its first argument is more than MAX_BIGINT / 10
14
bugs gh 7057 
 tracker
 SS 2024.07.29 16:57
458 298 298 304 458 304 488 544 488 412 412 412 412 453 453 453 330 330 330 360 497 497 478 478 478 478
Client-side positioned updates work wrongly with scrollable cursors
15
bugs gh 7744 
 tracker
 SS 2023.11.12 10:17
X X X X X X X X X X X X X X X X X X 1962 1304 1250 1204 1204 1204 1772 1772
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
16
bugs gh 7899 
 tracker
 CS 2024.01.12 15:40
X X X X X X X X X X X X X X X X X X 1248 751 1248 751 751 751 725 725
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
17
bugs gh 7962 
 tracker
 CS 2024.01.23 05:23
X X X X X X X X X X X X X X X X X X 1085 638 638 623 623 623 657 741
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
18
bugs gh 8061 
 tracker
 CS 2025.04.16 17:03
X X X X X X X X X X X X X X X X X X 1776 1183 1183 1183 1206 1206 1206 1712
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
19
bugs gh 8290 
 tracker
 CS 2024.10.26 08:21
X X X X X X X X X X X X X X X X X X 1191 755 1313 858 888 858 858 742
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
20
functional arno optimizer opt avoid index usage 
 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X X X 1168 774 774 774 910 772 910 910
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
21
functional fkey primary insert pk 09 
 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X X X 1388 913 913 913 888 888 888 995
Check correct work fix with foreign key
22
functional fkey primary upd pk 02 
 SS 2022.02.04 18:05
680 442 442 648 648 704 704 704 710 724 629 629 633 633 633 697 697 702 697 623 623 623 531 508 531 508
Check correct work fix with foreign key
23
functional gtcs division by zero corrupts db 
 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X X X 1223 775 1244 1244 1217 1192 1192 823
Zero divide in SP can crash database when call this SP several times
24
functional gtcs gtcs proc isql 13 
 SS 2022.02.04 18:05
1107 714 714 796 796 802 857 936 1004 1029 1029 1025 1025 1029 1025 1025 1030 1030 1024 1024 1024 961 945 945 945 903
gtcs-proc-isql-13

Elapsed time, milliseconds:

NN Test name mode
6.0.0.909
2025.07.04
1e2ef
6.0.0.894
2025.07.03
789ba
6.0.0.892
2025.07.02
10f7d
6.0.0.889
2025.07.01
969ac
6.0.0.884
2025.06.30
f7e5f
6.0.0.881
2025.06.27
7035d
6.0.0.877
2025.06.26
8e38f
6.0.0.876
2025.06.25
b1bec
6.0.0.863
2025.06.24
c3c20
6.0.0.858
2025.06.23
8d6f7
6.0.0.849
2025.06.20
7b79c
6.0.0.848
2025.06.19
c483c
6.0.0.845
2025.06.18
22b12
6.0.0.843
2025.06.16
995f4
6.0.0.840
2025.06.14
29bca
6.0.0.838
2025.06.13
0e28a
6.0.0.835
2025.06.12
2cf29
6.0.0.834
2025.06.11
e889f
6.0.0.800
2025.06.10
1f226
6.0.0.799
2025.06.07
be644
6.0.0.797
2025.06.06
303e8
6.0.0.795
2025.05.29
7a71a
6.0.0.792
2025.05.28
b4327
6.0.0.791
2025.05.27
02db8
6.0.0.789
2025.05.21
64051
6.0.0.787
2025.05.20
230ad
6.0.0.783
2025.05.12
37320
6.0.0.779
2025.05.11
136fa
6.0.0.778
2025.05.07
d735e
6.0.0.776
2025.05.06
007cd
Test TITLE
1
bugs core 1482 
 tracker
 CS 1907 1510 896 1741 892 864 1300 1465 X X X X X X X X X X 1611 1460 1596 1598 1692 1517 1533 1700 908 1386 1454 1743
Make optimizer to consider ORDER BY optimization when making decision about join order
2
bugs core 1492 
 tracker
 CS 1155 1198 576 1024 632 660 1058 1042 1012 1020 656 636 636 696 1094 1159 610 584 1119 1061 1428 1136 1205 1301 1099 1096 727 989 1066 1002
BLOB isn't compatible with [VAR]CHAR in COALESCE
3
bugs core 1512 
 tracker
 CS 1145 1083 652 1196 666 636 703 1100 974 1101 1075 657 694 670 1140 1113 1028 667 1180 1069 1127 988 1322 1147 1111 1082 756 1116 1134 1078
Connection lost running script
4
bugs core 1514 
 tracker
 CS 1090 1060 626 1056 615 607 854 1041 1082 1058 921 633 606 638 1159 980 1075 588 1126 1046 1163 1062 1225 1199 1049 1076 746 1002 1017 1153
Many new 2.1 built in functions have incorrect NULL semantics
5
bugs core 1522 
 tracker
 CS 1048 1043 655 1104 550 680 546 919 758 1010 980 594 560 539 1025 986 871 689 647 1109 968 1032 1130 1177 1060 994 745 865 1058 1141
Inconsistent DATEDIFF behaviour
6
bugs core 1784 
 tracker
 CS 1284 1297 759 X X 1272 774 704 814 700 811 783 785 1272 701 1139 1392 1129 786 795 1261 1426 881 1432 1352 830 873 1404 1381 1436
Error with EXECUTE PROCEDURE inside EXECUTE STATEMENT
7
bugs core 1810 
 tracker
 CS 1514 1576 767 1461 906 856 936 1067 843 945 825 826 832 1360 1613 1005 843 1470 932 795 1643 1540 1710 1641 1511 1549 992 1609 1609 1574
Usernames with '.' character
8
bugs core 1811 
 tracker
 CS 1241 1348 762 1276 764 779 723 937 723 812 816 795 749 1255 1276 790 733 837 768 807 1317 1264 1436 1410 1397 1216 838 1282 1384 1344
Incorrect parser's reaction to the unquoted usage of the keyword "VALUE"
9
bugs core 2907 
 tracker
 CS 1323 1340 1441 869 792 751 1328 756 1229 796 748 1375 808 1216 715 767 807 781 1355 1421 1261 1120 1162 1298 1191 804 867 1403 804 1364
Exception handling with EXECUTE STATEMENT
10
bugs core 2969 
 tracker
 CS 1108 635 1097 X X 624 982 639 672 580 1095 633 646 1205 667 1142 653 880 1136 1102 1074 1205 1212 801 1170 1206 705 948 1088 1204
rdb$set_context does NOT allow to overwrite any vars after encountering limit (default=1000) of them
11
bugs core 5070 
 tracker
 SS 660 676 438 737 X X X X X X X X X X X X X X 401 419 406 398 454 459 465 420 424 435 416 450
Compound index cannot be used for filtering in some ORDER/GROUP BY queries
12
bugs core 5183 
 tracker
 SS 600 323 394 603 620 333 365 335 395 369 678 310 555 582 383 574 605 621 389 417 408 388 404 431 437 395 432 358 441 419
Regression: line/column numbering may be twisted if alias.name syntax is used
13
bugs core 6356 
 tracker
 SS 551 346 567 588 288 320 469 469 303 396 616 697 578 637 405 511 457 567 426 339 415 459 438 459 428 460 412 418 430 427
ROUND() does not allow second argument >=1 when its first argument is more than MAX_BIGINT / 10
14
bugs gh 7057 
 tracker
 SS 520 499 272 298 458 289 304 544 488 298 669 546 292 412 330 453 467 460 328 330 293 554 497 360 538 478 336 535 369 538
Client-side positioned updates work wrongly with scrollable cursors
15
bugs gh 7744 
 tracker
 SS X X X X X X X X X X X X X X X X X X 1965 1962 1304 1250 2396 1204 1149 1160 1790 1981 1772 1677
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
16
bugs gh 7899 
 tracker
 CS X X X X X X X X X X X X X X X X X X 1464 643 1328 669 1248 751 1428 725 706 751 704 1484
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
17
bugs gh 7962 
 tracker
 CS X X X X X X X X X X X X X X X X X X 1085 604 1101 638 1210 589 611 623 741 1124 657 1083
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
18
bugs gh 8061 
 tracker
 CS X X X X X X X X X X X X X X X X X X 1844 1776 1132 1043 2343 1183 1206 1052 1712 1733 1168 1947
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
19
bugs gh 8290 
 tracker
 CS X X X X X X X X X X X X X X X X X X 1191 667 1313 683 1591 755 1344 858 888 702 717 742
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
20
functional arno optimizer opt avoid index usage 
 CS X X X X X X X X X X X X X X X X X X 1294 1307 689 774 1168 772 1411 760 910 758 1431 1363
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
21
functional fkey primary insert pk 09 
 CS X X X X X X X X X X X X X X X X X X 1388 874 817 1529 1464 913 855 852 888 1421 995 1363
Check correct work fix with foreign key
22
functional fkey primary upd pk 02 
 SS 683 799 432 680 364 442 648 704 710 788 570 629 782 724 432 575 633 702 697 729 616 717 623 435 716 375 531 508 630 422
Check correct work fix with foreign key
23
functional gtcs division by zero corrupts db 
 CS X X X X X X X X X X X X X X X X X X 1223 775 725 1449 1574 769 1244 1217 823 1192 758 747
Zero divide in SP can crash database when call this SP several times
24
functional gtcs gtcs proc isql 13 
 SS 1258 1107 714 1112 627 564 802 796 857 936 1036 1070 1004 1029 913 1025 1068 1036 1001 1010 1030 1051 1024 961 945 903 879 1079 954 727
gtcs-proc-isql-13

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1482
http://tracker.firebirdsql.org/browse/CORE-1492
http://tracker.firebirdsql.org/browse/CORE-1512
http://tracker.firebirdsql.org/browse/CORE-1514
http://tracker.firebirdsql.org/browse/CORE-1522
http://tracker.firebirdsql.org/browse/CORE-1784
http://tracker.firebirdsql.org/browse/CORE-1810
http://tracker.firebirdsql.org/browse/CORE-1811
http://tracker.firebirdsql.org/browse/CORE-2907
http://tracker.firebirdsql.org/browse/CORE-2969
http://tracker.firebirdsql.org/browse/CORE-5070
http://tracker.firebirdsql.org/browse/CORE-5183
http://tracker.firebirdsql.org/browse/CORE-6356
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_avoid_index_usage.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_insert_pk_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_upd_pk_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_division_by_zero_corrupts_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_gtcs_proc_isql_13.py
https://github.com/FirebirdSQL/firebird/issues/7057
https://github.com/FirebirdSQL/firebird/issues/7744
https://github.com/FirebirdSQL/firebird/issues/7899
https://github.com/FirebirdSQL/firebird/issues/7962
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8290
=== end of list ===

Last commits information (all timestamps in UTC):