01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (36 rows)
07. Has fails: tests with at least one fail for previous 30 runs (46 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (8 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2050 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated UTC 16.05.2025 18:22
Tested: HQ30.   Build / date: 3.0.13.33809-28ad086f / 2025.05.06;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Tests with performance slowdown for LAST 5 runs - moving medians

LAST moving median (window = 5) greater than previous for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and previous medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
18020 541 541 475 435 435 435 556 556 556 347 X X X X X X X X X X X X X X X
Too many grants lose privileges
2 CS 2022.05.27 07:52
177669 1120 1059 1044 1004 1004 1004 1172 1172 1172 851 X X X X X X X X X X X X X X X
RDB$procedures generator overflow
3 SS 2022.05.27 07:52
180098 565 536 527 515 515 515 517 517 517 376 X X X X X X X X X X X X X X X
RDB$procedures generator overflow
4 CS 2022.02.02 14:46
1300 8 8 6 8 8 8 8 8 8 8 X X X X X X X X X X X X X X X
Set the fixed and documented check order for WHERE clause and other conditional sentences
5 SS 2022.02.02 14:46
571 7 7 6 6 6 6 9 9 11 8 X X X X X X X X X X X X X X X
Set the fixed and documented check order for WHERE clause and other conditional sentences
6 CS 2025.02.07 09:03
83157 1055 1043 1043 1055 1123 1133 1133 1133 1108 963 X X X X X X X X X X X X X X X
Wrong results or unexpected errors while sorting a large data set
7 SS 2025.02.07 09:03
75834 537 513 511 511 513 530 582 582 582 433 X X X X X X X X X X X X X X X
Wrong results or unexpected errors while sorting a large data set
8 CS 2022.05.27 12:50
59332 1373 1322 1275 1233 1233 1233 1281 1281 1281 1107 X X X X X X X X X X X X X X X
New generators are created with wrong value when more than 32K generators was previously created
9 SS 2022.05.27 12:50
60947 679 647 621 546 546 546 707 707 707 516 X X X X X X X X X X X X X X X
New generators are created with wrong value when more than 32K generators was previously created
10 CS 2023.05.13 17:29
382656 1599 1504 1489 1467 1467 1467 1521 1521 1689 1521 X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
11 SS 2023.05.13 17:29
209281 1095 1058 1058 1003 940 X X X X X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
12 CS 2022.02.02 14:46
863 9 7 6 6 6 6 9 9 12 12 X X X X X X X X X X X X X X X
Report the remote port number in MON$ATTACHMENTS
13 SS 2022.02.02 14:46
404 8 7 7 6 6 6 6 6 6 5 X X X X X X X X X X X X X X X
Report the remote port number in MON$ATTACHMENTS
14 CS 2022.02.02 14:46
1679 9 8 7 6 7 7 9 9 9 9 X X X X X X X X X X X X X X X
Cannot CREATE VIEW that selects from a system table, despite having all grants
15 SS 2022.02.02 14:46
794 8 8 7 6 6 6 6 6 7 7 X X X X X X X X X X X X X X X
Cannot CREATE VIEW that selects from a system table, despite having all grants
16 CS 2022.02.02 14:46
933 8 7 7 7 8 7 8 7 7 6 X X X X X X X X X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
17 SS 2023.05.13 17:30
32329 630 593 567 540 540 540 540 540 493 423 X X X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
18 CS 2023.05.13 17:30
45837 1097 1062 1057 1050 1057 1057 1362 1362 1362 785 X X X X X X X X X X X X X X X
Bad optimization of some operations with views containing subqueries
19 SS 2023.05.13 17:30
47016 558 503 462 462 485 485 580 580 580 387 X X X X X X X X X X X X X X X
Bad optimization of some operations with views containing subqueries
20 SS 2022.02.02 14:46
477 6 6 6 6 6 6 7 9 11 9 X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 2024.06.09 15:53
134690 2454 2334 2312 2151 2151 2151 2454 2454 2454 2054 X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
22 SS 2024.06.09 15:53
135644 1864 1770 1725 1521 1521 1521 1763 1763 1763 1595 X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
23 CS 2023.08.12 05:31
978 7 7 7 6 6 5 6 5 7 6 X X X X X X X X X X X X X X X
Allow unused Common Table Expressions
24 SS 2023.08.12 05:31
497 7 6 6 6 7 9 10 10 9 7 X X X X X X X X X X X X X X X
Allow unused Common Table Expressions
25 CS 2022.02.02 14:46
1958 7 7 6 6 6 6 7 7 9 7 X X X X X X X X X X X X X X X
Error "no current record for fetch operation" is raised while deleting record from MON$ATTACHMENTS using ORDER BY clause
26 SS 2022.02.02 14:46
495 8 8 7 6 6 5 5 6 10 6 X X X X X X X X X X X X X X X
Error "no current record for fetch operation" is raised while deleting record from MON$ATTACHMENTS using ORDER BY clause
27 CS 2024.05.13 18:37
238433 1808 1725 1712 1712 1712 1787 1969 1969 1969 1640 X X X X X X X X X X X X X X X
Srp user manager sporadically creates users which can not attach
28 SS 2024.05.13 18:37
97394 924 905 897 824 824 824 1008 1008 1008 695 X X X X X X X X X X X X X X X
Srp user manager sporadically creates users which can not attach
29 CS 2022.02.02 14:46
1050 9 8 7 6 6 6 11 11 11 8 X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
30 SS 2022.02.02 14:46
479 9 7 7 6 6 6 7 7 7 7 X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
31 CS 2022.02.02 14:46
1053 8 7 6 6 6 6 8 8 9 8 X X X X X X X X X X X X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
32 SS 2022.02.02 14:46
439 8 7 7 7 7 7 7 7 7 7 X X X X X X X X X X X X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
33 CS 2023.05.13 17:32
74963 1506 1438 1422 1417 1417 1417 1429 1429 1429 1293 X X X X X X X X X X X X X X X
Wire compression causes freezes
34 SS 2023.05.13 17:32
73565 764 729 707 641 641 641 830 830 830 581 X X X X X X X X X X X X X X X
Wire compression causes freezes
35 CS 2023.12.29 06:22
18048 10 9 6 9 9 6 9 9 10 6 X X X X X X X X X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
36 SS 2023.12.29 06:22
19272 10 7 7 7 7 6 7 6 7 6 X X X X X X X X X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
37 CS 2022.02.04 18:05
1069 8 8 8 8 8 6 6 6 7 6 X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
38 CS 2025.01.13 11:44
2267 7 7 7 6 6 6 6 5 8 5 X X X X X X X X X X X X X X X
Create database: non sysdba user
39 SS 2025.01.13 11:44
1146 8 7 7 7 7 7 8 8 8 8 X X X X X X X X X X X X X X X
Create database: non sysdba user
40 CS 2023.10.06 22:33
1117 9 8 7 6 6 6 6 5 6 5 X X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
41 SS 2023.10.06 22:33
537 8 6 6 6 6 6 6 7 7 5 X X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
42 SS 2023.10.07 07:53
570 9 8 7 7 8 7 8 8 8 7 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
43 CS 2023.10.07 07:48
1040 9 7 7 6 6 6 6 6 6 6 X X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
44 SS 2023.10.07 07:48
519 7 6 6 6 6 6 11 11 12 11 X X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
45 CS 2022.02.04 18:05
1022 9 7 6 6 6 6 6 6 8 5 X X X X X X X X X X X X X X X
CREATE PROCEDURE - COMMIT in SP is not alowed
46 SS 2022.02.04 18:05
455 8 7 6 5 5 6 8 8 8 6 X X X X X X X X X X X X X X X
CREATE PROCEDURE - COMMIT in SP is not alowed
47 CS 2023.10.07 10:57
1259 8 6 6 5 5 5 5 7 7 7 X X X X X X X X X X X X X X X
CREATE TABLE - types
48 SS 2023.10.07 10:57
678 10 7 6 5 5 5 8 8 9 8 X X X X X X X X X X X X X X X
CREATE TABLE - types
49 CS 2022.02.04 18:05
1064 7 7 6 6 6 7 6 7 7 7 X X X X X X X X X X X X X X X
UPDATE/DETERE RETURNING should issue only one row when applying to table with self-referencing FK
50 SS 2022.02.04 18:05
515 9 8 6 6 6 6 6 6 6 6 X X X X X X X X X X X X X X X
UPDATE/DETERE RETURNING should issue only one row when applying to table with self-referencing FK

Elapsed time, milliseconds:

NN Test name mode
3.0.13.33809
2025.05.06
3.0.13.33808
2025.04.25
3.0.13.33803
2025.02.25
3.0.13.33796
2025.01.29
3.0.13.33796
2025.01.14
3.0.13.33795
2024.11.24
3.0.13.33794
2024.10.15
3.0.13.33793
2024.10.04
3.0.13.33792
2024.08.31
3.0.13.33787
2024.08.17
3.0.13.33787
2024.08.09
3.0.12.33746
2024.07.15
3.0.12.33746
2024.06.11
3.0.12.33744
2024.05.09
3.0.12.33744
2024.04.20
X X X X X X X X X X X X X X X
Test TITLE
1 SS 18020 19040 19020 475 541 541 388 426 435 1416 556 592 347 287 316 X X X X X X X X X X X X X X X
Too many grants lose privileges
2 CS 204145 193325 177669 1059 1120 1044 794 978 1004 2299 1172 1551 851 694 711 X X X X X X X X X X X X X X X
RDB$procedures generator overflow
3 SS 195886 193596 180098 536 527 565 438 436 515 1666 657 517 376 273 309 X X X X X X X X X X X X X X X
RDB$procedures generator overflow
4 CS 1342 1384 1300 6 8 8 5 5 9 10 8 8 6 16 10 X X X X X X X X X X X X X X X
Set the fixed and documented check order for WHERE clause and other conditional sentences
5 SS 571 598 621 7 7 6 6 5 9 12 6 11 8 15 6 X X X X X X X X X X X X X X X
Set the fixed and documented check order for WHERE clause and other conditional sentences
6 CS 85812 90309 83157 1008 1055 1043 814 1123 1133 2911 1299 1108 893 845 963 X X X X X X X X X X X X X X X
Wrong results or unexpected errors while sorting a large data set
7 SS 78557 79114 75834 537 511 513 386 492 530 1740 582 813 389 351 433 X X X X X X X X X X X X X X X
Wrong results or unexpected errors while sorting a large data set
8 CS 65436 61929 59332 1373 1322 1275 1016 1202 1233 3098 1486 1281 1107 992 998 X X X X X X X X X X X X X X X
New generators are created with wrong value when more than 32K generators was previously created
9 SS 64353 64935 60947 621 679 647 456 517 546 1156 707 763 516 408 414 X X X X X X X X X X X X X X X
New generators are created with wrong value when more than 32K generators was previously created
10 CS 405424 382656 389495 1599 1489 1504 1174 1467 1375 3515 1521 2349 1154 1689 1099 X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
11 SS 218346 209281 214526 1095 1058 1003 X X 940 1796 929 X 801 X X X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
12 CS 881 863 1003 7 6 9 6 6 5 9 12 13 7 26 5 X X X X X X X X X X X X X X X
Report the remote port number in MON$ATTACHMENTS
13 SS 441 404 485 7 8 7 5 5 6 8 6 5 5 6 5 X X X X X X X X X X X X X X X
Report the remote port number in MON$ATTACHMENTS
14 CS 1731 1679 1727 8 6 9 5 7 5 9 9 22 8 17 4 X X X X X X X X X X X X X X X
Cannot CREATE VIEW that selects from a system table, despite having all grants
15 SS 877 794 964 8 8 7 5 5 6 11 6 5 9 7 8 X X X X X X X X X X X X X X X
Cannot CREATE VIEW that selects from a system table, despite having all grants
16 CS 1063 1049 933 7 7 8 7 8 5 12 7 10 5 6 6 X X X X X X X X X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
17 SS 32329 34976 33287 567 593 630 394 484 540 1200 699 493 423 317 348 X X X X X X X X X X X X X X X
Performance regression when bulk inserting into table with indices
18 CS 51533 48408 45837 1062 1050 1097 826 1057 1017 2120 1362 1526 785 737 677 X X X X X X X X X X X X X X X
Bad optimization of some operations with views containing subqueries
19 SS 48483 51101 47016 558 462 503 415 441 485 1471 637 580 387 322 307 X X X X X X X X X X X X X X X
Bad optimization of some operations with views containing subqueries
20 SS 480 479 477 6 6 6 5 7 6 11 6 12 9 11 7 X X X X X X X X X X X X X X X
Error restoring on FB 3.0 from FB 2.5: bugcheck 221 (cannot remap)
21 CS 134690 135614 134907 2312 2454 2334 1755 1980 2151 3693 2454 2812 2054 1898 1968 X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
22 SS 135738 135644 135664 1864 1725 1770 1328 1521 1494 3024 1763 1821 1595 1389 1404 X X X X X X X X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
23 CS 1086 1009 978 7 7 7 5 6 5 10 5 10 5 7 6 X X X X X X X X X X X X X X X
Allow unused Common Table Expressions
24 SS 497 532 502 6 6 7 4 5 10 15 9 12 7 5 6 X X X X X X X X X X X X X X X
Allow unused Common Table Expressions
25 CS 2091 1958 2023 5 7 7 5 6 6 12 7 14 7 9 7 X X X X X X X X X X X X X X X
Error "no current record for fetch operation" is raised while deleting record from MON$ATTACHMENTS using ORDER BY clause
26 SS 513 503 495 8 7 8 6 5 5 10 5 17 6 16 5 X X X X X X X X X X X X X X X
Error "no current record for fetch operation" is raised while deleting record from MON$ATTACHMENTS using ORDER BY clause
27 CS 245989 243460 238433 1725 1808 1712 1407 1611 1787 4272 1969 2079 1640 1419 1302 X X X X X X X X X X X X X X X
Srp user manager sporadically creates users which can not attach
28 SS 97502 97394 99938 897 905 924 703 776 824 1738 1047 1008 695 685 653 X X X X X X X X X X X X X X X
Srp user manager sporadically creates users which can not attach
29 CS 1173 1050 1185 8 9 7 5 5 6 11 13 17 6 6 8 X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
30 SS 479 522 532 7 9 7 4 5 6 14 7 12 7 5 7 X X X X X X X X X X X X X X X
Inconsistent behavior regarding visibility of master record on detail inserts
31 CS 1065 1053 1088 6 7 8 6 6 6 9 8 10 6 22 7 X X X X X X X X X X X X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
32 SS 439 515 533 6 8 7 5 7 7 10 5 9 7 6 9 X X X X X X X X X X X X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
33 CS 78697 74963 82166 1438 1422 1506 1133 1398 1417 5005 1686 1429 1293 1145 1061 X X X X X X X X X X X X X X X
Wire compression causes freezes
34 SS 80188 73565 82670 707 729 764 534 636 641 2140 830 851 581 525 458 X X X X X X X X X X X X X X X
Wire compression causes freezes
35 CS 20453 18048 19330 6 9 10 6 6 9 10 5 12 5 13 6 X X X X X X X X X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
36 SS 20685 19272 19590 6 7 10 5 7 5 12 6 13 6 7 5 X X X X X X X X X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
37 CS 1137 1094 1069 6 8 8 8 6 6 8 6 5 7 23 5 X X X X X X X X X X X X X X X
ORDER BY ASC using index (multi) and WHERE clause
38 CS 2395 2532 2267 7 7 7 5 6 5 14 8 5 5 19 5 X X X X X X X X X X X X X X X
Create database: non sysdba user
39 SS 1200 1241 1146 7 6 8 7 4 7 11 8 13 7 8 4 X X X X X X X X X X X X X X X
Create database: non sysdba user
40 CS 1157 1117 1152 9 7 8 5 6 5 8 6 5 5 15 5 X X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
41 SS 616 581 537 5 8 6 5 6 6 11 5 7 8 5 5 X X X X X X X X X X X X X X X
CREATE DOMAIN - BLOB SEGMENT SIZE
42 SS 574 579 570 8 7 9 5 7 8 14 5 17 7 8 5 X X X X X X X X X X X X X X X
CREATE DOMAIN - DEFAULT USER
43 CS 1040 1078 1143 7 9 7 6 5 5 10 6 6 6 7 6 X X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
44 SS 519 560 593 6 6 7 5 5 6 12 11 16 5 21 7 X X X X X X X X X X X X X X X
CREATE DOMAIN - CHECK
45 CS 1044 1022 1032 9 7 6 6 6 6 10 5 8 5 19 5 X X X X X X X X X X X X X X X
CREATE PROCEDURE - COMMIT in SP is not alowed
46 SS 455 519 514 7 8 5 6 4 5 10 8 16 5 6 5 X X X X X X X X X X X X X X X
CREATE PROCEDURE - COMMIT in SP is not alowed
47 CS 1383 1259 1259 6 8 6 5 4 5 9 5 7 7 10 5 X X X X X X X X X X X X X X X
CREATE TABLE - types
48 SS 678 708 694 10 6 7 5 5 5 449 10 8 6 9 6 X X X X X X X X X X X X X X X
CREATE TABLE - types
49 CS 1094 1155 1064 7 5 6 7 5 6 12 7 6 9 7 6 X X X X X X X X X X X X X X X
UPDATE/DETERE RETURNING should issue only one row when applying to table with self-referencing FK
50 SS 515 601 518 6 9 8 5 5 6 12 6 5 5 12 6 X X X X X X X X X X X X X X X
UPDATE/DETERE RETURNING should issue only one row when applying to table with self-referencing FK

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1544
http://tracker.firebirdsql.org/browse/CORE-1971
http://tracker.firebirdsql.org/browse/CORE-216
http://tracker.firebirdsql.org/browse/CORE-2966
http://tracker.firebirdsql.org/browse/CORE-3058
http://tracker.firebirdsql.org/browse/CORE-4880
http://tracker.firebirdsql.org/browse/CORE-5028
http://tracker.firebirdsql.org/browse/CORE-5060
http://tracker.firebirdsql.org/browse/CORE-5270
http://tracker.firebirdsql.org/browse/CORE-5302
http://tracker.firebirdsql.org/browse/CORE-5393
http://tracker.firebirdsql.org/browse/CORE-5414
http://tracker.firebirdsql.org/browse/CORE-5648
http://tracker.firebirdsql.org/browse/CORE-5674
http://tracker.firebirdsql.org/browse/CORE-5684
http://tracker.firebirdsql.org/browse/CORE-6038
http://tracker.firebirdsql.org/browse/CORE-6138
http://tracker.firebirdsql.org/browse/CORE-6290
http://tracker.firebirdsql.org/browse/CORE-6348
http://tracker.firebirdsql.org/browse/CORE-6411
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_19.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_34.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_38.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/procedure/create/test_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_pg_14421.py
=== end of list ===

Last commits information (all timestamps in UTC):