01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (10 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (12 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (7 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (39 rows)
07. Has fails: tests with at least one fail for previous 30 runs (75 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (13 rows)
11. All tests: outcomes for previous 30 runs (2580 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 21.11.2024 07:56
Tested: HQ50.   Build / date: 5.0.2.1567-e1289f6d / 2024.11.18;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.11
X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46
8 8 5 8 9 9 9 9 8 8 9 8 8 X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
2 CS 2022.02.02 14:46
465 465 484 492 492 635 635 635 621 326 322 320 322 X X X X X X X X X X X X X
Table columns hide destination variables of RETURNING INTO
3 CS 2024.05.09 21:39
1290 1302 1316 1390 1413 1413 1316 1054 1040 768 762 762 762 X X X X X X X X X X X X X
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS 2022.02.02 14:46
13 11 10 10 11 11 9 9 6 6 6 7 7 X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5 SS 2022.02.02 14:46
7 7 5 5 8 8 9 9 9 8 8 8 8 X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 CS 2022.02.02 14:46
525 537 555 613 622 653 683 683 653 384 370 370 370 X X X X X X X X X X X X X
Incorrect result for the derived expression based on aggregate and computation
7 CS 2022.02.02 14:46
625 625 625 665 669 810 810 810 763 456 456 456 456 X X X X X X X X X X X X X
isql hangs when trying to show a view based on a procedure
8 SS 2022.02.02 14:46
3934 1385 1385 1385 1440 1440 1440 1386 1380 1215 1203 857 836 X X X X X X X X X X X X X
GFIX returns an error after correctly shutting down a database
9 SS 2022.02.02 14:46
244 246 262 270 282 340 359 359 340 180 180 173 180 X X X X X X X X X X X X X
Expressions containing some built-in functions may be badly optimized
10 CS 2024.10.31 10:17
439 462 467 470 506 584 648 648 584 318 313 313 307 X X X X X X X X X X X X X
Query cannot be executed if win1251 characters used in field aliases
11 SS 2024.10.31 10:17
8348 8875 8875 8911 10426 10426 10426 8599 8374 6162 6057 6057 6057 X X X X X X X X X X X X X
Query cannot be executed if win1251 characters used in field aliases
12 CS 2024.02.18 07:24
X 680 680 680 714 799 802 802 799 504 503 501 486 X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
13 SS 2023.09.28 12:18
281 281 281 281 281 344 344 344 315 198 198 198 215 X X X X X X X X X X X X X
User with DROP DATABASE privilege can't drop database
14 CS 2022.02.02 14:46
447 457 470 487 491 583 606 606 583 323 318 308 307 X X X X X X X X X X X X X
Firebird server segfaults in the end of database backup
15 CS 2024.05.15 17:26
3547 3548 3549 3557 3599 3728 3728 3728 3690 2645 2645 2643 2643 X X X X X X X X X X X X X
Trace could not work correctly with quoted file names in trace configurations
16 CS 2023.03.01 14:13
736 752 752 752 851 851 771 771 770 548 531 513 488 X X X X X X X X X X X X X
Allow sub-routines to access variables/parameters defined at the outer/parent level [CORE4449]
17 CS 2024.07.22 17:04
1894 1921 1945 2030 2030 2030 1398 937 890 832 X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
18 SS 2024.07.22 17:04
970 970 978 978 979 978 978 565 564 564 X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
19 CS 2022.02.02 14:46
44457 44670 44785 44894 45467 45467 45467 3836 3747 3321 3207 3183 3207 X X X X X X X X X X X X X
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
20 SS 2022.02.02 14:46
44810 45109 45109 45124 45167 45167 44197 2919 2736 2468 2455 2415 2415 X X X X X X X X X X X X X
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
21 CS 2023.12.29 20:35
8868 9014 9266 10045 10535 10535 10535 5374 5089 5036 4975 5025 4975 X X X X X X X X X X X X X
Performance degradation with CURRENT_DATE, LOCALTIME and LOCALTIMESTAMP
22 SS 2023.12.29 20:35
7748 8923 9205 9308 9648 9648 9648 4998 4794 4610 4610 4689 4644 X X X X X X X X X X X X X
Performance degradation with CURRENT_DATE, LOCALTIME and LOCALTIMESTAMP
23 CS 2023.03.03 21:49
19053 19089 19097 19097 19188 19319 30434 31276 31276 30434 30311 29619 5222 X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
24 SS 2023.03.03 21:49
15692 15692 15753 15753 16091 16417 23174 23692 23692 23174 23119 22654 4478 X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
25 CS 2023.12.14 16:42
4597 4636 4849 4905 5224 5224 5224 5081 4915 4789 826 826 794 X X X X X X X X X X X X X
Inconsistent conversion of non-TEXT blobs in BLOB_APPEND
26 SS 2023.12.14 16:42
1675 1675 1682 1698 2196 2192 2192 2192 2143 1654 446 426 415 X X X X X X X X X X X X X
Inconsistent conversion of non-TEXT blobs in BLOB_APPEND
27 CS 2023.09.27 21:01
34544 35249 35616 36045 37262 37262 37262 1483 1375 1142 1065 1065 1050 X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
28 SS 2023.09.27 21:01
30446 30446 30586 30586 36739 36739 36739 951 903 783 726 714 714 X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
29 CS 2024.05.15 07:41
794 794 797 797 919 919 919 788 735 531 498 498 494 X X X X X X X X X X X X X
Error isc_read_only_trans (335544361) should report SQLSTATE 25006.
30 SS 2024.05.15 07:41
508 507 507 507 527 507 460 451 437 276 275 275 257 X X X X X X X X X X X X X
Error isc_read_only_trans (335544361) should report SQLSTATE 25006.
31 CS 2023.03.10 09:39
3705 3708 3739 3744 3744 3744 1568 775 713 556 539 496 496 X X X X X X X X X X X X X
Test for TRUNC function
32 SS 2023.03.10 09:39
2936 2942 2947 2991 2991 2947 1193 464 450 312 307 289 289 X X X X X X X X X X X X X
Test for TRUNC function
33 CS 2024.07.20 21:01
831 857 893 897 924 924 924 858 808 526 X X X X X X X X X X X X X X X X
Scrollable cursors. Automated test with randomly generated mission for positioning.
34 SS 2024.07.20 21:01
556 562 562 571 631 571 530 497 460 314 X X X X X X X X X X X X X X X X
Scrollable cursors. Automated test with randomly generated mission for positioning.
35 CS 2023.09.13 08:23
1176 1252 1321 1350 1374 1408 1433 1433 1408 1199 1169 1096 535 X X X X X X X X X X X X X
Fixed crash when IN predicate is delivered into aggregates/unions
36 SS 2023.09.13 08:23
630 640 680 685 691 745 859 859 745 692 657 651 260 X X X X X X X X X X X X X
Fixed crash when IN predicate is delivered into aggregates/unions
37 CS 2024.07.19 13:20
964 991 964 991 1017 1017 798 798 780 530 X X X X X X X X X X X X X X X X
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
38 SS 2024.07.19 13:20
445 448 448 451 472 448 468 468 388 276 X X X X X X X X X X X X X X X X
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
39 CS 2022.02.04 18:05
778 790 798 820 854 854 820 811 798 518 499 499 473 X X X X X X X X X X X X X
Check ability to run selectable SP with input parameter which inserts into GTT (on commit DELETE rows) and then does suspend

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.2.1567
2024.11.18
5.0.2.1533
2024.10.23
5.0.2.1533
2024.10.22
5.0.2.1532
2024.10.15
5.0.2.1518
2024.10.04
5.0.2.1518
2024.09.26
5.0.2.1489
2024.09.05
5.0.2.1489
2024.08.31
5.0.2.1476
2024.08.09
5.0.1.1454
2024.08.08
5.0.1.1453
2024.08.06
5.0.1.1453
2024.07.30
5.0.1.1453
2024.07.28
5.0.1.1429
2024.07.19
5.0.1.1428
2024.07.15
5.0.1.1428
2024.06.30
5.0.1.1415
2024.06.11
X X X X X X X X X X X X X
Test TITLE
1 SS 2022.02.02 14:46 324 311 5 8 5 11 5 9 14 8 9 7 4 10 9 8 5 X X X X X X X X X X X X X
Unable to set FName, MName, LName fields in security to blank
2 CS 2022.02.02 14:46 442 448 484 507 465 433 492 1093 1304 635 621 314 326 318 322 320 335 X X X X X X X X X X X X X
Table columns hide destination variables of RETURNING INTO
3 CS 2024.05.09 21:39 1239 1302 1290 1267 1390 1413 1316 2623 2195 1040 1054 737 762 768 749 882 715 X X X X X X X X X X X X X
Can't transliterate character set when look at procedure text in database just created from script (and thus in ODS 11.1)
4 CS 2022.02.02 14:46 593 633 13 10 4 11 6 11 12 9 6 6 5 7 7 8 5 X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
5 SS 2022.02.02 14:46 393 345 7 5 5 8 5 27 11 6 9 9 8 8 7 10 5 X X X X X X X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 CS 2022.02.02 14:46 521 525 537 555 484 622 613 1376 1101 653 683 384 366 370 362 402 380 X X X X X X X X X X X X X
Incorrect result for the derived expression based on aggregate and computation
7 CS 2022.02.02 14:46 597 626 597 625 669 623 665 936 1547 810 763 436 456 450 481 498 410 X X X X X X X X X X X X X
isql hangs when trying to show a view based on a procedure
8 SS 2022.02.02 14:46 3934 4713 4613 1385 1183 1320 1440 1901 2944 1386 1380 1215 1203 836 857 813 795 X X X X X X X X X X X X X
GFIX returns an error after correctly shutting down a database
9 SS 2022.02.02 14:46 223 244 246 262 235 282 270 365 546 340 359 173 167 180 182 171 182 X X X X X X X X X X X X X
Expressions containing some built-in functions may be badly optimized
10 CS 2024.10.31 10:17 423 415 462 439 467 506 470 998 1385 584 648 318 307 313 304 325 291 X X X X X X X X X X X X X
Query cannot be executed if win1251 characters used in field aliases
11 SS 2024.10.31 10:17 5850 9351 5936 8911 8348 8875 10426 10851 18159 8599 6162 8374 5786 6057 5953 6149 8088 X X X X X X X X X X X X X
Query cannot be executed if win1251 characters used in field aliases
12 CS 2024.02.18 07:24 X 575 680 680 605 714 668 1219 1102 799 802 504 501 503 474 476 486 X X X X X X X X X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
13 SS 2023.09.28 12:18 248 262 286 301 281 249 264 471 549 344 315 198 181 192 227 228 215 X X X X X X X X X X X X X
User with DROP DATABASE privilege can't drop database
14 CS 2022.02.02 14:46 440 442 470 447 457 487 491 618 1027 583 606 323 307 277 318 308 303 X X X X X X X X X X X X X
Firebird server segfaults in the end of database backup
15 CS 2024.05.15 17:26 3545 3506 3548 3549 3547 3557 3599 3728 4108 3797 3690 2625 2623 2645 2664 2643 2611 X X X X X X X X X X X X X
Trace could not work correctly with quoted file names in trace configurations
16 CS 2023.03.01 14:13 707 717 759 736 752 851 738 1244 1775 770 771 531 548 513 479 488 448 X X X X X X X X X X X X X
Allow sub-routines to access variables/parameters defined at the outer/parent level [CORE4449]
17 CS 2024.07.22 17:04 1871 1872 1894 1921 1945 2030 2083 3907 1398 890 937 774 832 792 X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
18 SS 2024.07.22 17:04 939 855 1007 970 993 947 978 1536 979 468 565 509 564 593 X X X X X X X X X X X X X X X X
Add transaction info fb_info_tra_snapshot_number [CORE6017]
19 CS 2022.02.02 14:46 41229 41311 44670 44457 44785 44894 45467 53105 94579 3747 3836 3183 3321 3146 3207 3154 3257 X X X X X X X X X X X X X
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
20 SS 2022.02.02 14:46 39810 41854 44810 45124 45109 45167 44197 53797 98315 2919 2736 2366 2414 2468 2455 2415 2375 X X X X X X X X X X X X X
Support for WHEN NOT MATCHED BY SOURCE for MERGE statement
21 CS 2023.12.29 20:35 7736 8868 9014 8386 9266 10045 10535 14814 17522 5374 4226 5089 5036 4975 4842 5025 4839 X X X X X X X X X X X X X
Performance degradation with CURRENT_DATE, LOCALTIME and LOCALTIMESTAMP
22 SS 2023.12.29 20:35 7398 7748 8923 7292 9308 9205 9648 12633 19449 4998 4037 4794 4473 4610 4801 4689 4644 X X X X X X X X X X X X X
Performance degradation with CURRENT_DATE, LOCALTIME and LOCALTIMESTAMP
23 CS 2023.03.03 21:49 19053 18429 18543 19089 19097 19319 19188 18994 48954 31276 30434 31918 29619 30311 5222 5167 4871 X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
24 SS 2023.03.03 21:49 16541 15692 15469 15646 15753 16091 16417 14357 41560 23174 24366 23692 22654 23119 4386 4478 4179 X X X X X X X X X X X X X
Nbackup RDB$BACKUP_HISTORY cleanup
25 CS 2023.12.14 16:42 4386 4486 4636 4597 4849 4905 5224 7506 8860 5081 4789 4915 794 826 779 838 734 X X X X X X X X X X X X X
Inconsistent conversion of non-TEXT blobs in BLOB_APPEND
26 SS 2023.12.14 16:42 1808 1675 1647 1650 2196 1682 1698 2624 3572 2192 2143 1654 446 394 389 426 415 X X X X X X X X X X X X X
Inconsistent conversion of non-TEXT blobs in BLOB_APPEND
27 CS 2023.09.27 21:01 33069 34544 35249 36045 34135 35616 37262 48123 53609 1483 1375 1142 1050 1004 1065 1176 1024 X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
28 SS 2023.09.27 21:01 28883 30446 30649 29525 30586 29864 36739 43131 47376 951 903 686 714 783 726 686 695 X X X X X X X X X X X X X
Regression when displaying line number of errors in ISQL scripts
29 CS 2024.05.15 07:41 797 758 865 794 790 797 919 1055 1073 788 735 531 498 480 451 503 494 X X X X X X X X X X X X X
Error isc_read_only_trans (335544361) should report SQLSTATE 25006.
30 SS 2024.05.15 07:41 508 550 477 497 527 507 604 460 683 437 451 275 251 276 257 284 255 X X X X X X X X X X X X X
Error isc_read_only_trans (335544361) should report SQLSTATE 25006.
31 CS 2023.03.10 09:39 3635 3705 3708 3739 3657 3930 3744 6003 1568 775 713 467 539 556 471 496 495 X X X X X X X X X X X X X
Test for TRUNC function
32 SS 2023.03.10 09:39 2922 2925 2936 2942 3002 2947 2991 3308 1193 464 450 307 248 312 261 289 297 X X X X X X X X X X X X X
Test for TRUNC function
33 CS 2024.07.20 21:01 778 765 857 831 897 893 924 1442 1602 808 858 524 526 520 X X X X X X X X X X X X X X X X
Scrollable cursors. Automated test with randomly generated mission for positioning.
34 SS 2024.07.20 21:01 500 520 556 562 631 571 530 753 1049 460 497 299 305 314 X X X X X X X X X X X X X X X X
Scrollable cursors. Automated test with randomly generated mission for positioning.
35 CS 2023.09.13 08:23 1167 1168 1176 1252 1350 1374 1321 2188 2227 1408 1433 1096 1199 1169 454 502 535 X X X X X X X X X X X X X
Fixed crash when IN predicate is delivered into aggregates/unions
36 SS 2023.09.13 08:23 590 606 630 640 691 685 680 1017 1225 745 859 692 657 651 253 253 260 X X X X X X X X X X X X X
Fixed crash when IN predicate is delivered into aggregates/unions
37 CS 2024.07.19 13:20 947 1008 964 952 991 1181 627 1017 1081 780 798 530 529 527 X X X X X X X X X X X X X X X X
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
38 SS 2024.07.19 13:20 444 421 445 451 472 448 363 501 815 388 468 276 256 268 X X X X X X X X X X X X X X X X
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
39 CS 2022.02.04 18:05 725 771 790 798 778 854 820 1391 2066 798 811 518 473 469 499 536 471 X X X X X X X X X X X X X
Check ability to run selectable SP with input parameter which inserts into GTT (on commit DELETE rows) and then does suspend

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1256
http://tracker.firebirdsql.org/browse/core-1291
http://tracker.firebirdsql.org/browse/core-1363
http://tracker.firebirdsql.org/browse/core-2339
http://tracker.firebirdsql.org/browse/core-2735
http://tracker.firebirdsql.org/browse/core-3548
http://tracker.firebirdsql.org/browse/core-4460
http://tracker.firebirdsql.org/browse/core-5389
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5790
http://tracker.firebirdsql.org/browse/core-5936
http://tracker.firebirdsql.org/browse/core-5991
http://tracker.firebirdsql.org/browse/core-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_trunc_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_6cfc9b5d.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_8816d5c8.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_90129c6d.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_eqc_344124.py
https://github.com/FirebirdSQL/firebird/issues/4769
https://github.com/FirebirdSQL/firebird/issues/6267
https://github.com/FirebirdSQL/firebird/issues/6681
https://github.com/FirebirdSQL/firebird/issues/7090
https://github.com/FirebirdSQL/firebird/issues/7186
https://github.com/FirebirdSQL/firebird/issues/7256
https://github.com/FirebirdSQL/firebird/issues/7761
https://github.com/FirebirdSQL/firebird/issues/8112
=== end of list ===

Last commits information (all timestamps in UTC):