01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (825 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (13 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
07. Has fails: tests with at least one fail for previous 30 runs (1874 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (294 rows)
11. All tests: outcomes for previous 30 runs (3633 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 03.07.2025 02:36
Tested: FB60.   Build / date: 6.0.0.892-10f7dc35 / 2025.07.02;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
6.0.0.892
2025.07.02
6.0.0.889
2025.07.01
6.0.0.884
2025.06.30
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
Test TITLE
1 SS 2023.11.12 10:17
X X X X X X X X X X X X X X X X 1962 1304 1250 1204 1204 1204 1772 1772 1790 1981
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
2 CS 2024.01.12 15:40
X X X X X X X X X X X X X X X X 1248 751 1248 751 751 751 725 725 751 843
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
3 CS 2024.01.23 05:23
X X X X X X X X X X X X X X X X 1085 638 638 623 623 623 657 741 1083 1083
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
4 CS 2025.04.16 17:03
X X X X X X X X X X X X X X X X 1776 1183 1183 1183 1206 1206 1206 1712 1733 1733
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
5 CS 2024.10.26 08:21
X X X X X X X X X X X X X X X X 1191 755 1313 858 888 858 858 742 742 740
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
6 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X 1168 774 774 774 910 772 910 910 910 1363
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
7 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X 1388 913 913 913 888 888 888 995 1351 1351
Check correct work fix with foreign key
8 CS 2022.02.04 18:05
X X X X X X X X X X X X X X X X 1223 775 1244 1244 1217 1192 1192 823 758 758
Zero divide in SP can crash database when call this SP several times
9 SS 2023.11.25 21:39
1311 759 949 1311 1064 1064 1064 1064 827 827 733 698 698 905 964 1073 1073 1073 1460 1529 1529 1529 1221 1172 1031 1031
Check ability of outer join simplification.
10 SS 2023.11.25 21:40
1132 731 918 1156 1156 1126 1126 1126 786 786 737 786 811 1052 1071 1123 1141 1141 1231 1370 1370 1231 1432 1346 1346 1498
Check ability of outer join simplification.
11 SS 2023.11.25 21:42
1377 769 1377 1377 1079 920 920 895 767 767 705 705 719 1156 1376 1376 1376 1376 1455 1225 1294 1294 1294 1048 1132 1029
Check ability of outer join simplification.
12 SS 2023.11.25 21:42
1357 700 1359 1359 1308 1308 1308 1297 749 749 696 685 749 1002 1002 1436 1436 1436 1436 1503 1417 1520 1520 1520 1402 1402
Check ability of outer join simplification.
13 SS 2022.02.04 18:05
603 383 338 338 338 338 338 357 357 357 357 358 358 397 463 572 588 593 635 635 635 635 625 607 595 607
Multiple triggers on start transaction

Elapsed time, milliseconds:

NN Test name mode
6.0.0.892
2025.07.02
6.0.0.889
2025.07.01
6.0.0.884
2025.06.30
6.0.0.881
2025.06.27
6.0.0.877
2025.06.26
6.0.0.876
2025.06.25
6.0.0.863
2025.06.24
6.0.0.858
2025.06.23
6.0.0.849
2025.06.20
6.0.0.848
2025.06.19
6.0.0.845
2025.06.18
6.0.0.843
2025.06.16
6.0.0.840
2025.06.14
6.0.0.838
2025.06.13
6.0.0.835
2025.06.12
6.0.0.834
2025.06.11
6.0.0.800
2025.06.10
6.0.0.799
2025.06.07
6.0.0.797
2025.06.06
6.0.0.795
2025.05.29
6.0.0.792
2025.05.28
6.0.0.791
2025.05.27
6.0.0.789
2025.05.21
6.0.0.787
2025.05.20
6.0.0.783
2025.05.12
6.0.0.779
2025.05.11
6.0.0.778
2025.05.07
6.0.0.776
2025.05.06
6.0.0.770
2025.05.05
6.0.0.767
2025.05.01
Test TITLE
1 SS X X X X X X X X X X X X X X X X 1965 1962 1304 1250 2396 1204 1149 1160 1790 1981 1772 1677 2209 2435
Provide ability to run "ALTER SQL SECURITY DEFINER / INVOKER" without specifying further part of proc/func/package
2 CS X X X X X X X X X X X X X X X X 1464 643 1328 669 1248 751 1428 725 706 751 704 1484 1209 843
Inconsistent state of master-detail occurs after RE-connect + 'SET AUTODDL OFF' + 'drop <FK>' which is ROLLED BACK
3 CS X X X X X X X X X X X X X X X X 1085 604 1101 638 1210 589 611 623 741 1124 657 1083 1093 672
System procedure/function inconsistency between ISQL SHOW FUNCTIONS and SHOW PROCEDURES
4 CS X X X X X X X X X X X X X X X X 1844 1776 1132 1043 2343 1183 1206 1052 1712 1733 1168 1947 2411 1126
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
5 CS X X X X X X X X X X X X X X X X 1191 667 1313 683 1591 755 1344 858 888 702 717 742 1350 740
"Unique scan" is incorrectly reported in the explained plan for unique index and IS NULL predicate
6 CS X X X X X X X X X X X X X X X X 1294 1307 689 774 1168 772 1411 760 910 758 1431 1363 877 1604
AVOID index usage in WHERE <indexed_varchar_field> = <integer_value>
7 CS X X X X X X X X X X X X X X X X 1388 874 817 1529 1464 913 855 852 888 1421 995 1363 1351 804
Check correct work fix with foreign key
8 CS X X X X X X X X X X X X X X X X 1223 775 725 1449 1574 769 1244 1217 823 1192 758 747 743 1320
Zero divide in SP can crash database when call this SP several times
9 SS 1416 682 759 1333 1311 734 949 1366 1064 1339 827 733 698 905 694 689 1473 964 1073 1460 945 1672 1664 1529 1221 1172 944 1016 1031 1643
Check ability of outer join simplification.
10 SS 1132 694 664 1188 1440 731 918 1156 1419 1126 737 677 786 1052 665 811 1350 1071 1123 1141 1370 1231 1545 1432 1142 1042 1698 1346 1556 1498
Check ability of outer join simplification.
11 SS 1511 764 674 1377 1453 769 1429 1079 920 895 767 705 673 1156 650 719 1500 1376 1516 1186 1225 1455 1690 1048 1294 889 1532 792 1132 1029
Check ability of outer join simplification.
12 SS 1357 700 666 1466 1359 700 1461 1297 1308 1356 696 685 749 1556 667 670 1556 1002 1436 1503 1417 1608 1269 1528 1244 1520 1544 1402 1276 1187
Check ability of outer join simplification.
13 SS 645 383 329 603 683 337 338 335 417 338 357 460 343 358 347 463 572 397 593 588 682 635 653 625 485 669 607 595 587 728
Multiple triggers on start transaction

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_avoid_index_usage.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/fkey/primary/test_insert_pk_09.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_division_by_zero_corrupts_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_join_transformation_001.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_join_transformation_002.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_join_transformation_004.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_join_transformation_005.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/database/test_transaction_start_multiple_with_normal_finish.py
https://github.com/FirebirdSQL/firebird/issues/7744
https://github.com/FirebirdSQL/firebird/issues/7899
https://github.com/FirebirdSQL/firebird/issues/7962
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8290
=== end of list ===

Last commits information (all timestamps in UTC):