01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (28 rows)
07. Has fails: tests with at least one fail for previous 30 runs (17 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2572 rows)
12. Skipped: tests which was intentionally excluded from execution (74 rows)

Generated UTC 23.02.2025 04:12
Tested: FB50.   Build / date: 5.0.3.1622-c1a518f0 / 2025.02.22;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
5.0.2.1606
2025.02.01
5.0.2.1605
2025.01.31
5.0.2.1604
2025.01.27
5.0.2.1602
2025.01.24
5.0.2.1601
2025.01.21
5.0.2.1597
2025.01.20
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
Test TITLE
1 SS 2025.01.18 11:26
14953 15210 14953 15210 15215 15215 15215 15424 15215 14938 14938 14200 14200 14423 14423 14842 14842 15068 15068 13893 9182 8963 8963 9182 9182 8963
Count (DISTINCT ...) is too slow
2 CS 2023.11.25 22:13
13432 13356 13343 13273 12504 12504 13273 13273 12972 13083 13083 13083 13083 13083 13355 13388 13388 13542 13542 13388 7571 7224 7224 7195 7224 7195
Dependencies are not removed after dropping the procedure and the table it depends on in the same transaction
3 CS 2022.02.02 14:46
4306 4068 4059 4306 4059 4057 4059 4091 4091 4105 4105 4105 4105 3976 3976 4155 4155 4155 4155 2629 2608 2629 2608 2584 2583 2583
Segfault when closing attachment to database
4 SS 2022.02.07 17:03
2108 2136 2136 2315 2315 2315 2315 2264 2248 2235 2235 2131 2131 2235 2131 2115 2299 2248 2115 2075 1347 1347 1347 1347 1339 1340
User savepoints are not released on commit
5 SS 2022.02.02 14:46
1364 1364 1449 1449 1449 1431 1431 1407 1397 1397 1421 1396 1421 1461 1461 1451 1467 1471 1451 1451 909 905 901 901 909 903
Regression: SP "Domain" and "Type Of" based variables referring BLOB with sub_type < 0 no longer work
6 SS 2024.05.07 17:40
13257 13257 13257 13257 13231 12987 12987 12987 12730 12577 12577 12532 12532 12577 12532 12382 12621 12621 12382 12382 7997 7997 7997 8137 8137 8137
Efficient table scans for DBKEY-based range conditions
7 SS 2022.02.02 14:46
81815 81815 81815 81353 84900 84900 84900 82633 82633 81922 81922 81051 81051 81922 81998 82030 83352 84274 83352 82030 48886 48354 48319 48354 48319 48319
Server crashes on overflow of division result
8 CS 2024.08.21 10:58
15963 15268 14567 14567 16126 15846 15846 16126 15846 15846 15306 15306 14799 14799 14756 14799 14756 14103 12868 12279 8066 8066 8066 8304 8304 8304
Engine cant determine datatype in SQL: Unknown SQL Data type (32752) [CORE6168]
9 SS 2024.08.21 10:58
15710 15710 15166 15811 15811 15714 15714 15714 14276 14276 14441 13992 14441 15177 14498 14912 15232 15485 14912 14912 7801 7793 7742 7793 7801 7829
Engine cant determine datatype in SQL: Unknown SQL Data type (32752) [CORE6168]
10 SS 2024.08.15 19:03
50829 50829 50740 51831 52013 51831 51831 51831 50509 50509 50509 48244 48244 48786 48786 49965 52040 52040 52040 52040 25137 24883 24880 24883 24830 24830
Error writing to TIMESTAMP/TIME WITH TIME ZONE array
11 CS 2022.02.02 14:46
13630 14162 14162 14162 13496 12799 12799 13496 12457 13186 13292 13292 13186 13186 12794 12794 12794 12845 12845 12845 10624 1735 1151 1112 1110 1094
Add way to retrieve statement BLR with Statement::getInfo and ISQL's SET EXEC_PATH_DISPLAY BLR
12 SS 2022.02.02 14:46
11048 9703 10866 10866 10382 9892 10382 10382 10221 10221 10556 10221 10184 9820 9820 9820 9820 10330 10330 10330 8165 799 794 794 789 794
Add way to retrieve statement BLR with Statement::getInfo and ISQL's SET EXEC_PATH_DISPLAY BLR
13 SS 2022.02.02 14:46
10 8 8 8 8 8 8 8 9 9 10 10 9 9 9 9 8 8 8 8 5 5 5 5 5 5
Incorrect singleton error with MERGE and RETURNING
14 CS 2023.12.14 16:36
15022 14790 14301 14301 15075 14854 14854 15075 14854 14767 14192 14544 14408 14408 14408 14544 14408 14147 8670 8670 8643 8670 8794 8794 8643 8835
Results of negation must be the same for each datatype (smallint / int /bigint / int128) when argument is least possible value for this type
15 SS 2023.12.14 16:36
13957 13987 13987 13854 14026 13854 13854 14647 14647 14322 14322 14116 13709 13709 13316 13662 13709 13854 13662 13662 8131 8131 8131 8131 8131 8081
Results of negation must be the same for each datatype (smallint / int /bigint / int128) when argument is least possible value for this type
16 CS 2023.03.03 21:49
33616 33616 32915 32915 36000 33067 33067 34432 34432 33067 32576 34139 34139 32576 34139 34718 34718 32202 18307 18307 18307 18307 18735 18735 18660 18309
Nbackup RDB$BACKUP_HISTORY cleanup
17 SS 2023.03.03 21:49
27734 27734 28127 28466 28466 28360 28127 27445 26905 26905 26469 26469 26469 26749 26749 27578 27578 27578 16113 16070 15719 15848 15762 15762 15762 15848
Nbackup RDB$BACKUP_HISTORY cleanup
18 CS 2025.01.19 14:06
2958 2848 2698 2698 2978 2906 2906 2978 2964 2906 2885 2885 2885 2885 2908 2965 2965 2965 2965 1729 1704 1681 1681 1681 1681 1688
The partial index is not involved when filtering conditions through OR.
19 CS 2024.05.15 14:41
2009 2041 1971 2044 2044 1950 1944 825 825 825 828 829 836 836 836 836 836 852 776 746 705 683 683 683 670 664
Engine returns empty string when unable to translate Unicode symbol into ICU-codepage.
20 SS 2024.05.15 14:41
1602 1550 1551 1576 1551 1519 1519 651 493 493 493 493 493 485 485 485 485 487 487 434 362 362 359 339 357 339
Engine returns empty string when unable to translate Unicode symbol into ICU-codepage.
21 SS 2024.12.21 10:45
2730 2713 2713 2720 2720 2697 2720 2722 2722 2718 2718 2698 1225 1225 1225 2288 2288 2290 2290 2288 X X X X X X
Report unique usernames for isc_info_user_names
22 SS 2025.01.18 17:38
16452 16452 16452 16621 16452 16109 16109 16109 16109 16109 16000 2315 2312 X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
23 SS 2024.05.09 22:22
1040 1040 1000 1034 1000 1000 1026 1026 1026 1026 1016 1016 1011 1005 1005 1005 1000 972 948 893 536 536 533 533 533 522
Create database: set names and default character set
24 SS 2023.10.06 22:33
8 10 8 9 8 9 9 9 11 11 10 8 8 8 8 8 11 12 12 12 5 5 5 6 6 6
CREATE DOMAIN - BLOB SEGMENT SIZE
25 SS 2022.02.07 17:03
1129 1080 1129 1129 1080 1080 1051 1051 1003 1059 1059 1059 999 1054 1054 1054 1069 1082 1082 1082 663 663 653 653 669 669
Verify result of ALTER DOMAIN with changing DEFAULT values and DROP constraints when a table exists with field based on this domain
26 CS 2023.10.07 10:21
5977 5766 5766 5766 6098 6317 6317 6317 6317 5783 5783 5783 5783 5917 5971 5971 5971 5971 4660 3062 3062 3062 3059 3059 3059 3059
ALTER TABLE - DROP CONSTRAINT - UNIQUE
27 SS 2023.10.07 10:21
5786 5672 5634 5672 5683 5672 5553 5683 5642 5553 5424 5424 5424 5424 5304 5304 5304 5282 4844 4319 2854 2854 2854 2874 2874 2958
ALTER TABLE - DROP CONSTRAINT - UNIQUE
28 SS 2023.12.16 11:04
358360 355650 355650 355650 360316 355650 344783 360316 344783 344783 331345 331345 331345 356994 356994 356994 356994 355699 213590 212051 177917 177917 175374 177917 177917 177450
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
5.0.2.1606
2025.02.01
5.0.2.1605
2025.01.31
5.0.2.1604
2025.01.27
5.0.2.1602
2025.01.24
5.0.2.1601
2025.01.21
5.0.2.1597
2025.01.20
5.0.2.1595
2025.01.17
5.0.2.1593
2025.01.16
5.0.2.1592
2025.01.15
5.0.2.1590
2025.01.14
5.0.2.1589
2025.01.13
5.0.2.1585
2025.01.11
5.0.2.1584
2025.01.09
5.0.2.1583
2024.12.23
5.0.2.1582
2024.12.19
5.0.2.1580
2024.12.13
5.0.2.1579
2024.12.12
5.0.2.1577
2024.12.11
5.0.2.1576
2024.12.10
5.0.2.1575
2024.12.08
5.0.2.1571
2024.12.02
Test TITLE
1 SS 2025.01.18 11:26 14347 15481 14195 14953 15210 15315 14735 15581 15215 13967 15431 15424 14200 14938 14013 13482 14423 14842 15068 15471 13893 15613 8743 8844 9182 8963 9230 10005 7295 8785
Count (DISTINCT ...) is too slow
2 CS 2023.11.25 22:13 14414 13432 13356 14868 13343 12504 11836 13273 12049 13276 15593 12972 12693 13083 13355 13645 12760 12501 13591 13388 13542 14216 7571 6998 7224 7195 7586 6994 7261 7044
Dependencies are not removed after dropping the procedure and the table it depends on in the same transaction
3 CS 2022.02.02 14:46 4357 4068 3886 4432 4306 3824 4059 4565 4057 3820 4091 4277 4228 4105 3867 3846 4318 3976 4155 4343 2376 4700 2629 2584 2608 4740 2573 2583 2572 2594
Segfault when closing attachment to database
4 SS 2022.02.07 17:03 2088 2155 2136 1815 2108 2354 2465 2315 2264 2139 2466 2248 2112 2235 2131 2034 2368 2299 2115 2075 2327 2248 1347 1347 1339 1321 1395 1576 1318 1340
User savepoints are not released on commit
5 SS 2022.02.02 14:46 1601 1364 1121 1330 1449 1529 1520 1431 1407 1397 1542 1396 1234 1421 1461 1294 1467 1471 1365 1451 1524 1572 905 878 909 867 901 1026 965 903
Regression: SP "Domain" and "Type Of" based variables referring BLOB with sub_type < 0 no longer work
6 SS 2024.05.07 17:40 13851 11620 11948 13257 14260 15321 12220 13231 12987 12113 14068 12730 11949 12577 12532 11748 12635 12621 12247 12382 12786 13644 7873 7997 7878 8278 8137 8445 7985 7872
Efficient table scans for DBKEY-based range conditions
7 SS 2022.02.02 14:46 86970 85638 81815 79935 79657 85387 84900 81353 85739 80517 86305 82633 80058 81922 81051 77388 81998 84274 83352 82030 86493 88923 47928 48354 48886 48319 48110 51039 47522 48683
Server crashes on overflow of division result
8 CS 2024.08.21 10:58 16177 15963 15268 14189 17328 14517 14567 16150 16126 15846 14183 16380 15306 16073 14688 14799 14756 15320 14103 16199 12868 12279 7705 7815 8066 13353 8304 8434 8239 8079
Engine cant determine datatype in SQL: Unknown SQL Data type (32752) [CORE6168]
9 SS 2024.08.21 10:58 15971 15710 13893 14439 16293 16030 15166 15811 15714 14276 16032 13992 13753 15177 14441 13904 15232 15752 14498 14912 15485 16271 7696 7647 7801 7793 7742 8504 7829 7863
Engine cant determine datatype in SQL: Unknown SQL Data type (32752) [CORE6168]
10 SS 2024.08.15 19:03 51498 50829 50504 47058 52013 53252 50740 51831 54963 49235 54094 50509 47664 52758 46613 48244 48786 52320 49965 52040 52040 56740 24880 24883 25137 24822 24732 26061 24830 25355
Error writing to TIMESTAMP/TIME WITH TIME ZONE array
11 CS 2022.02.02 14:46 13630 12834 12667 21598 14162 14198 12799 13496 12300 12457 16143 13648 12375 13186 13292 13954 12794 12665 12716 12845 13288 13282 10624 1151 1110 1735 1094 1112 1075 985
Add way to retrieve statement BLR with Statement::getInfo and ISQL's SET EXEC_PATH_DISPLAY BLR
12 SS 2022.02.02 14:46 11367 9132 9377 11048 11357 9703 10866 10382 9892 9149 10945 10627 10221 9560 10556 10184 8941 9820 9514 10330 10716 11340 8165 799 787 794 789 838 789 869
Add way to retrieve statement BLR with Statement::getInfo and ISQL's SET EXEC_PATH_DISPLAY BLR
13 SS 2022.02.02 14:46 11 10 11 8 8 7 8 8 7 9 5 10 11 7 10 9 9 7 9 8 8 8 5 5 5 7 5 5 5 7
Incorrect singleton error with MERGE and RETURNING
14 CS 2023.12.14 16:36 15022 16006 14790 13128 16575 14301 13921 15075 16433 14854 13760 15327 14767 14090 14192 14544 14408 15125 14147 15113 6981 7309 8670 8794 8643 9449 8914 8438 8551 8835
Results of negation must be the same for each datatype (smallint / int /bigint / int128) when argument is least possible value for this type
15 SS 2023.12.14 16:36 13957 13452 13987 13023 14026 14127 13854 13237 14742 12426 14647 14819 14116 14322 13316 12021 13709 13854 13041 13662 14950 16130 8011 8057 8131 8341 8531 8079 7922 8081
Results of negation must be the same for each datatype (smallint / int /bigint / int128) when argument is least possible value for this type
16 CS 2023.03.03 21:49 32178 38735 33616 13997 36558 32915 31517 36000 36379 33067 13021 34432 34574 32576 31751 34139 35102 32202 34718 34990 13846 14400 18307 18735 18902 14287 18994 18169 18660 18309
Nbackup RDB$BACKUP_HISTORY cleanup
17 SS 2023.03.03 21:49 29577 26699 27734 25358 29357 29614 28127 28466 28360 26905 12943 27445 24490 27211 26469 24599 26749 28199 28007 27578 11663 16070 16113 15719 15537 15848 15762 16430 15725 15966
Nbackup RDB$BACKUP_HISTORY cleanup
18 CS 2025.01.19 14:06 3335 2848 2958 1762 3089 2659 2698 2978 3409 2906 1771 3117 2964 2885 2769 2706 2975 2908 2965 2972 1704 3497 1613 1729 1681 1329 1710 1584 1688 1735
The partial index is not involved when filtering conditions through OR.
19 CS 2024.05.15 14:41 2009 2041 1957 1971 2044 2062 1950 2048 1944 825 705 821 873 859 828 829 836 932 852 746 776 939 705 683 670 612 699 705 653 664
Engine returns empty string when unable to translate Unicode symbol into ICU-codepage.
20 SS 2024.05.15 14:41 1602 1478 1550 2490 1693 1483 1551 1576 1519 445 651 434 493 510 426 509 478 485 487 434 556 553 359 336 362 372 339 326 357 336
Engine returns empty string when unable to translate Unicode symbol into ICU-codepage.
21 SS 2024.12.21 10:45 2730 2713 2713 2778 2771 2697 2657 2720 2722 2655 2755 2722 2698 2718 1220 1019 1225 2288 2290 2288 2413 3311 2215 2217 X X X X X X
Report unique usernames for isc_info_user_names
22 SS 2025.01.18 17:38 16780 16246 16254 23857 16452 16621 16039 17119 16089 16109 21560 16000 16328 227 2312 2315 2308 X X X X X X X X X X X X X
Crash when creating index on table that uses UDR and ParallelWorkers > 1
23 SS 2024.05.09 22:22 1009 1055 869 1355 1040 984 1000 1034 993 1026 1378 1016 1074 927 1011 1040 1000 1005 948 1012 893 972 536 512 533 558 506 627 496 522
Create database: set names and default character set
24 SS 2023.10.06 22:33 6 11 8 16 6 10 8 9 7 11 14 6 11 10 8 8 7 6 11 12 19 16 5 5 5 6 8 6 6 6
CREATE DOMAIN - BLOB SEGMENT SIZE
25 SS 2022.02.07 17:03 1129 1054 960 1539 1129 1080 1145 1051 1003 1130 680 1059 921 1108 1072 943 999 1054 1069 1082 1375 1155 663 653 650 681 644 737 669 656
Verify result of ALTER DOMAIN with changing DEFAULT values and DROP constraints when a table exists with field based on this domain
26 CS 2023.10.07 10:21 6102 6143 5977 2987 5766 5610 6700 6098 6667 6317 2757 6382 5320 5783 6052 5634 5917 6130 5971 6103 2992 4660 2965 3062 3219 2472 3059 2839 3080 3199
ALTER TABLE - DROP CONSTRAINT - UNIQUE
27 SS 2023.10.07 10:21 5856 5786 5634 5362 5952 5672 5396 5683 5929 5553 3233 5812 5642 5424 4879 5169 5788 5786 5304 5282 4844 4319 2854 2752 2826 3713 2874 3033 2831 2958
ALTER TABLE - DROP CONSTRAINT - UNIQUE
28 SS 2023.12.16 11:04 376539 338187 358360 228152 380760 355650 342127 360316 396636 344783 198683 373352 331345 364279 321563 323660 359516 356994 358125 355699 212051 213590 174725 172934 177917 207562 175374 178653 173109 177450
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-214
http://tracker.firebirdsql.org/browse/CORE-3314
http://tracker.firebirdsql.org/browse/CORE-3732
http://tracker.firebirdsql.org/browse/CORE-4382
http://tracker.firebirdsql.org/browse/CORE-4623
http://tracker.firebirdsql.org/browse/CORE-6278
http://tracker.firebirdsql.org/browse/CORE-6345
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_dsql_domain_21.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/table/alter/test_11.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/6416
https://github.com/FirebirdSQL/firebird/issues/6545
https://github.com/FirebirdSQL/firebird/issues/6910
https://github.com/FirebirdSQL/firebird/issues/6942
https://github.com/FirebirdSQL/firebird/issues/7025
https://github.com/FirebirdSQL/firebird/issues/7186
https://github.com/FirebirdSQL/firebird/issues/7804
https://github.com/FirebirdSQL/firebird/issues/8108
https://github.com/FirebirdSQL/firebird/issues/8353
https://github.com/FirebirdSQL/firebird/issues/8386
=== end of list ===

Last commits information (all timestamps in UTC):