01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (8 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (24 rows)
07. Has fails: tests with at least one fail for previous 30 runs (85 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2592 rows)
12. Skipped: tests which was intentionally excluded from execution (78 rows)

Generated UTC 21.11.2024 02:15
Tested: FB50.   Build / date: 5.0.2.1567-9fbd574d / 2024.11.16;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.33x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
5.0.2.1567
2024.11.16
9fbd5
5.0.2.1566
2024.11.15
6db71
5.0.2.1565
2024.11.14
d5fa4
5.0.2.1564
2024.11.12
6866e
5.0.2.1561
2024.11.08
ae88c
5.0.2.1560
2024.11.07
98836
5.0.2.1555
2024.11.06
0c5eb
5.0.2.1553
2024.11.04
1eacd
5.0.2.1551
2024.10.30
53a92
5.0.2.1550
2024.10.29
9eecd
5.0.2.1547
2024.10.24
1e08f
5.0.2.1542
2024.10.23
7d501
5.0.2.1539
2024.10.22
a7912
5.0.2.1537
2024.10.21
e5b4a
5.0.2.1535
2024.10.17
a153b
5.0.2.1532
2024.10.14
40552
5.0.2.1530
2024.10.11
2d8e7
5.0.2.1529
2024.10.09
57afb
5.0.2.1528
2024.10.06
ce72c
5.0.2.1526
2024.10.05
e1874
5.0.2.1525
2024.10.02
02d09
5.0.2.1520
2024.09.30
fc48a
5.0.2.1519
2024.09.26
4e350
5.0.2.1518
2024.09.25
f88f0
5.0.2.1516
2024.09.23
fe6ba
5.0.2.1513
2024.09.21
ade6b
Test TITLE
1
bugs core 0856 
 tracker
 CS 2022.02.02 14:46
590 623 624 623 623 586 586 28 11 10 5 6 5 5 6 6 6 6 6 6 6 6 6 6 6 12
Unable to set FName, MName, LName fields in security to blank
2
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
598 600 612 612 629 612 581 20 7 6 6 6 5 6 6 6 6 7 7 7 7 7 7 8 8 11
ISQL crash when converted-from-double string longer than 23 bytes
3
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
354 338 338 338 335 284 270 25 16 16 25 16 18 25 25 18 23 23 5 5 5 5 5 5 5 6
ISQL crash when converted-from-double string longer than 23 bytes
4
bugs core 1971 
 tracker
 SS 2022.02.02 14:46
17 17 17 12 6 12 12 12 8 13 8 8 8 7 7 7 7 7 6 6 7 7 7 7 7 11
Set the fixed and documented check order for WHERE clause and other conditional sentences
5
bugs core 2216 
 tracker
 CS 2022.02.02 14:46
709 709 709 711 711 693 660 42 8 7 7 7 6 6 5 6 6 6 6 6 6 6 6 7 9 9
Nbackup as online dump
6
bugs core 2216 
 tracker
 SS 2022.02.02 14:46
426 421 453 453 421 353 353 33 28 21 14 6 14 21 14 7 27 7 6 6 6 6 7 10 10 11
Nbackup as online dump
7
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
694 709 709 721 709 709 704 25 7 6 6 6 6 6 7 7 7 7 7 6 6 7 8 10 11 10
ASCII_VAL raises error instead of return 0 for empty strings
8
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
430 427 408 397 405 381 381 23 20 16 12 12 12 12 23 23 16 16 6 6 6 6 6 6 11 12
ASCII_VAL raises error instead of return 0 for empty strings
9
bugs core 4131 
 tracker
 CS 2023.07.29 18:30
18510 18510 18325 18510 19160 19162 19446 19446 19162 19097 18767 18491 18491 18395 18033 18033 18066 18066 18559 18559 18559 10072 10038 10038 10038 11252
Error when processing an empty data set by window function, if reading indexed
10
bugs core 4331 
 tracker
 CS 2022.02.02 14:46
22503 22503 22453 22453 22551 23308 22551 23308 23308 22586 22311 22586 22311 22434 22382 22434 22382 22434 22382 21676 20110 13096 13032 13032 13096 15462
LAG, LEAD and NTH_VALUE raise error when the second argument is NULL
11
bugs core 5380 
 tracker
 CS 2022.02.02 14:46
1306 1306 1300 1075 619 618 619 619 642 642 642 664 664 669 669 701 701 656 656 661 656 661 661 619 619 683
Allow subroutines to call others subroutines and themself recursively
12
bugs core 5380 
 tracker
 SS 2022.02.02 14:46
1030 1030 1030 391 369 368 360 368 368 375 384 392 392 408 392 392 408 408 411 411 403 397 403 397 397 397
Allow subroutines to call others subroutines and themself recursively
13
bugs core 5463 
 tracker
 CS 2023.07.18 08:54
830 817 840 840 817 803 785 37 7 7 6 7 6 6 6 8 8 8 8 7 6 6 5 5 12 12
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5463 
 tracker
 SS 2023.07.18 08:54
483 497 481 497 485 485 481 8 8 7 6 6 6 6 6 6 6 6 6 6 5 6 6 6 6 7
Support GENERATED ALWAYS identity columns and OVERRIDE clause
15
bugs gh 7257 
 tracker
 SS 2023.02.18 11:30
504 522 504 502 480 470 466 326 321 321 326 326 332 332 337 348 348 332 340 339 339 339 339 332 332 332
Support for partial indices
16
bugs gh 7288 
 tracker
 SS 2023.02.21 08:06
4785 4785 4785 4785 1032 1032 1032 1032 1033 1066 1096 1096 1107 1122 1122 1146 1146 1146 1138 1088 1088 1088 1088 1059 1083 1083
Server crashes when working with DSQL savepoints
17
functional arno indices upper lower bounds 01 
 SS 2022.02.04 18:05
526 526 526 387 372 371 371 371 383 391 391 391 391 390 390 385 385 384 385 385 394 394 394 394 391 391
Upper and lower bounds
18
functional domain create 29 
 CS 2023.10.06 22:33
7 7 8 7 7 5 6 6 6 6 6 5 5 5 5 7 7 7 7 7 7 6 7 7 7 12
CREATE DOMAIN - BLOB SEGMENT SIZE
19
functional intfunc string left 01 
 CS 2022.02.04 18:05
4132 4132 4220 4220 3986 3936 3936 22 5 5 5 6 6 6 6 6 6 6 6 6 6 6 6 6 8 7
LEFT function
20
functional intfunc string left 01 
 SS 2022.02.04 18:05
3843 3818 3838 3838 3838 3795 3795 5 5 5 5 5 6 6 6 6 6 6 6 6 6 6 6 6 6 6
LEFT function
21
functional intfunc string right 01 
 CS 2022.02.04 18:05
4073 4073 4073 4029 3981 3895 3845 21 5 5 5 6 6 6 6 7 9 9 10 10 6 5 6 6 6 6
RIGHT( <string>, <number> )
22
functional intfunc string right 01 
 SS 2022.02.04 18:05
3833 3833 3833 3822 3821 3729 3703 6 6 6 6 6 6 6 6 6 7 7 6 7 7 7 7 7 6 6
RIGHT( <string>, <number> )
23
functional tabloid 90129c6d 
 CS 2024.07.19 13:20
905 905 901 885 885 X X 885 890 929 929 918 943 943 943 943 983 983 983 916 916 635 575 575 575 575
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
24
functional trigger create 06 
 SS 2022.02.04 18:05
569 569 597 597 413 413 435 435 435 444 436 436 435 436 436 444 468 468 444 444 421 421 426 484 448 496
CREATE TRIGGER AFTER DELETE

Elapsed time, milliseconds:

NN Test name mode Test last update
5.0.2.1567
2024.11.16
9fbd5
5.0.2.1566
2024.11.15
6db71
5.0.2.1565
2024.11.14
d5fa4
5.0.2.1564
2024.11.12
6866e
5.0.2.1561
2024.11.08
ae88c
5.0.2.1560
2024.11.07
98836
5.0.2.1555
2024.11.06
0c5eb
5.0.2.1553
2024.11.04
1eacd
5.0.2.1551
2024.10.30
53a92
5.0.2.1550
2024.10.29
9eecd
5.0.2.1547
2024.10.24
1e08f
5.0.2.1542
2024.10.23
7d501
5.0.2.1539
2024.10.22
a7912
5.0.2.1537
2024.10.21
e5b4a
5.0.2.1535
2024.10.17
a153b
5.0.2.1532
2024.10.14
40552
5.0.2.1530
2024.10.11
2d8e7
5.0.2.1529
2024.10.09
57afb
5.0.2.1528
2024.10.06
ce72c
5.0.2.1526
2024.10.05
e1874
5.0.2.1525
2024.10.02
02d09
5.0.2.1520
2024.09.30
fc48a
5.0.2.1519
2024.09.26
4e350
5.0.2.1518
2024.09.25
f88f0
5.0.2.1516
2024.09.23
fe6ba
5.0.2.1513
2024.09.21
ade6b
5.0.2.1512
2024.09.20
66b5f
5.0.2.1509
2024.09.19
f0aec
5.0.2.1508
2024.09.18
1ea82
5.0.2.1502
2024.09.16
0799c
Test TITLE
1
bugs core 0856 
 tracker
 CS 2022.02.02 14:46 572 584 645 590 623 624 1166 586 586 10 5 28 11 4 4 6 5 6 6 25 6 6 5 11 6 5 6 25 15 12
Unable to set FName, MName, LName fields in security to blank
2
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 598 591 578 600 629 612 1030 581 632 7 6 20 5 6 6 4 5 6 7 19 5 7 5 8 8 6 7 19 15 11
ISQL crash when converted-from-double string longer than 23 bytes
3
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 506 293 499 354 338 284 335 407 270 13 25 7 16 35 36 16 18 25 29 5 23 5 5 5 5 4 25 6 5 11
ISQL crash when converted-from-double string longer than 23 bytes
4
bugs core 1971 
 tracker
 SS 2022.02.02 14:46 6 20 17 17 5 23 6 12 6 13 25 5 8 20 7 20 6 7 31 6 8 6 5 7 7 24 32 5 4 11
Set the fixed and documented check order for WHERE clause and other conditional sentences
5
bugs core 2216 
 tracker
 CS 2022.02.02 14:46 751 695 698 709 730 729 660 711 693 8 7 42 7 6 5 7 5 6 5 24 6 7 6 6 5 7 9 26 25 9
Nbackup as online dump
6
bugs core 2216 
 tracker
 SS 2022.02.02 14:46 426 347 648 701 421 349 453 668 353 28 33 5 6 21 14 6 32 27 7 6 28 6 4 6 7 35 21 10 5 11
Nbackup as online dump
7
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 693 731 694 721 683 709 1290 721 704 7 5 25 6 4 6 8 6 8 7 7 6 7 6 5 11 8 10 18 23 10
ASCII_VAL raises error instead of return 0 for empty strings
8
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 430 610 455 397 427 363 408 381 405 23 20 5 16 6 12 31 6 23 28 6 16 5 6 6 6 39 19 6 11 12
ASCII_VAL raises error instead of return 0 for empty strings
9
bugs core 4131 
 tracker
 CS 2023.07.29 18:30 20459 19269 18204 18325 18510 19160 16210 19446 19162 55084 19478 16579 19097 18491 18767 18031 18395 17834 18033 18066 18907 19804 18559 10072 9871 9915 10038 11687 11252 12455
Error when processing an empty data set by window function, if reading indexed
10
bugs core 4331 
 tracker
 CS 2022.02.02 14:46 27359 22503 23275 22190 22453 23737 21889 22551 23308 28138 22168 24017 19518 22586 22311 22769 21697 22434 22382 24171 20110 28004 21676 12579 13096 13032 12794 15980 15972 15462
LAG, LEAD and NTH_VALUE raise error when the second argument is NULL
11
bugs core 5380 
 tracker
 CS 2022.02.02 14:46 828 1306 1368 1300 1360 618 1075 597 619 607 642 792 664 621 637 669 705 701 643 1321 656 644 702 661 601 683 619 596 1195 1058
Allow subroutines to call others subroutines and themself recursively
12
bugs core 5380 
 tracker
 SS 2022.02.02 14:46 521 957 1115 1060 1030 369 350 391 360 368 346 375 384 427 447 392 387 408 387 411 414 355 414 387 403 397 422 356 363 643
Allow subroutines to call others subroutines and themself recursively
13
bugs core 5463 
 tracker
 CS 2023.07.18 08:54 830 716 808 840 843 817 1027 803 785 7 4 37 6 7 6 10 6 6 8 16 8 6 7 5 5 12 5 12 25 12
Support GENERATED ALWAYS identity columns and OVERRIDE clause
14
bugs core 5463 
 tracker
 SS 2023.07.18 08:54 483 501 475 497 475 526 481 500 485 8 7 6 11 6 6 8 6 5 7 6 5 6 5 7 5 7 6 6 7 11
Support GENERATED ALWAYS identity columns and OVERRIDE clause
15
bugs gh 7257 
 tracker
 SS 2023.02.18 11:30 487 522 504 544 502 537 470 466 480 288 320 326 321 332 337 309 348 332 377 362 297 317 340 339 342 332 312 314 359 532
Support for partial indices
16
bugs gh 7288 
 tracker
 SS 2023.02.21 08:06 4803 4775 4782 4785 4799 4820 1032 983 1014 1033 1066 1032 1096 1153 1107 1055 1122 1321 1146 1196 1138 1047 1088 1043 1357 1252 1044 1059 1083 1701
Server crashes when working with DSQL savepoints
17
functional arno indices upper lower bounds 01 
 SS 2022.02.04 18:05 365 512 575 575 526 372 387 361 371 350 383 393 428 391 390 331 397 384 443 385 372 364 397 394 412 383 391 439 366 655
Upper and lower bounds
18
functional domain create 29 
 CS 2023.10.06 22:33 5 5 8 11 7 5 16 5 8 5 6 18 6 5 5 5 7 5 7 18 8 6 5 7 7 6 7 33 29 12
CREATE DOMAIN - BLOB SEGMENT SIZE
19
functional intfunc string left 01 
 CS 2022.02.04 18:05 4098 4010 4132 4220 4241 3935 6114 3936 3986 5 5 22 5 5 6 6 8 5 6 21 5 7 6 6 8 6 5 22 24 7
LEFT function
20
functional intfunc string left 01 
 SS 2022.02.04 18:05 3843 3769 3818 3877 3863 3687 3838 3795 3844 5 5 5 6 7 5 5 6 7 6 5 7 6 6 7 6 7 5 6 5 10
LEFT function
21
functional intfunc string right 01 
 CS 2022.02.04 18:05 4059 4075 4073 4029 4215 3895 6296 3845 3981 5 4 21 5 6 5 6 6 9 7 21 10 5 11 4 6 5 6 16 15 6
RIGHT( <string>, <number> )
22
functional intfunc string right 01 
 SS 2022.02.04 18:05 3860 3728 3892 3833 3821 3842 3822 3729 3703 6 6 5 7 6 5 6 6 7 6 7 8 5 5 9 7 7 6 5 6 12
RIGHT( <string>, <number> )
23
functional tabloid 90129c6d 
 CS 2024.07.19 13:20 873 905 964 950 901 X X 860 876 885 929 890 967 1024 918 893 943 1105 983 884 983 916 983 572 635 572 575 1031 516 962
Scrollable cursors. Fixed isBof/isEof when the prefetch is active
24
functional trigger create 06 
 SS 2022.02.04 18:05 429 446 569 598 597 407 633 408 413 444 435 646 435 451 436 432 435 470 468 444 476 404 412 484 421 496 426 583 448 659
CREATE TRIGGER AFTER DELETE

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1363
http://tracker.firebirdsql.org/browse/core-1971
http://tracker.firebirdsql.org/browse/core-2216
http://tracker.firebirdsql.org/browse/core-3479
http://tracker.firebirdsql.org/browse/core-4131
http://tracker.firebirdsql.org/browse/core-4331
http://tracker.firebirdsql.org/browse/core-5380
http://tracker.firebirdsql.org/browse/core-5463
http://tracker.firebirdsql.org/browse/core-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/indices/test_upper_lower_bounds_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_29.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_90129c6d.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/trigger/create/test_06.py
https://github.com/FirebirdSQL/firebird/issues/7257
https://github.com/FirebirdSQL/firebird/issues/7288
=== end of list ===

Last commits information (all timestamps in UTC):