01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (50 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (20 rows)
07. Has fails: tests with at least one fail for previous 30 runs (9 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2008 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated UTC 31.03.2025 08:09
Tested: FB30.   Build / date: 3.0.13.33806-b6cfe472 / 2025.03.26;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33806
2025.03.26
b6cfe
3.0.13.33805
2025.03.17
98320
3.0.13.33804
2025.02.25
1439d
3.0.13.33803
2025.01.29
f1848
3.0.13.33802
2025.01.28
650bd
3.0.13.33800
2025.01.20
f20ab
3.0.13.33798
2025.01.16
0c3bb
3.0.13.33795
2024.12.23
1bf0b
3.0.13.33794
2024.10.23
e2a6b
3.0.13.33793
2024.09.02
3e627
3.0.13.33792
2024.08.30
d9f38
3.0.13.33791
2024.08.21
c8a36
3.0.13.33790
2024.08.20
3bf52
3.0.13.33789
2024.08.09
7933a
3.0.12.33787
2024.08.06
bf180
3.0.12.33784
2024.08.01
cd857
3.0.12.33779
2024.07.31
ae35d
3.0.12.33778
2024.07.21
4680d
3.0.12.33777
2024.07.19
8e912
3.0.12.33766
2024.07.13
b5086
3.0.12.33765
2024.07.10
06f2a
3.0.12.33764
2024.06.18
4d0c0
3.0.12.33761
2024.06.17
b259d
3.0.12.33758
2024.06.14
4f9bc
3.0.12.33757
2024.06.13
c7a1c
3.0.12.33744
2024.04.19
ecf36
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46
17967 18220 18220 18220 17967 17382 11134 6291 6278 4617 4617 2897 2854 2695 2535 2525 2486 2486 2464 2464 2464 2363 X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46
16678 16741 16741 16741 16741 15640 11323 6533 4666 4088 4088 2386 2371 2209 2164 2164 2149 2094 2093 2093 2092 2092 X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46
867 869 869 880 880 775 628 11 10 10 10 7 7 5 6 6 5 5 6 7 8 8 X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46
481 481 481 476 436 419 377 11 11 10 10 9 7 7 8 8 8 8 7 6 6 7 X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46
822 831 839 839 822 810 616 16 11 10 10 10 9 9 9 7 7 7 7 7 8 7 X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46
444 494 494 494 481 481 425 16 13 10 12 10 9 9 9 8 9 9 6 6 6 6 X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2215 
 tracker
 CS 2022.02.02 14:46
983 983 995 995 995 969 718 15 12 9 9 5 5 5 5 6 6 6 6 6 7 7 X X X X
GROUP BY concatenation with empty string
8
bugs core 2215 
 tracker
 SS 2022.02.02 14:46
624 624 631 624 609 571 438 14 13 12 12 10 8 7 7 7 7 7 7 8 11 11 X X X X
GROUP BY concatenation with empty string
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46
1053 1053 1053 1041 968 929 710 21 11 10 10 8 6 6 7 7 8 8 7 7 7 7 X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46
535 566 625 594 594 594 484 10 9 9 9 8 8 8 7 8 7 7 7 7 7 7 X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5270 
 tracker
 CS 2022.02.02 14:46
22 8 8 8 9 8 9 9 11 11 11 10 8 8 8 8 8 8 5 8 7 6 X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
12
bugs core 5457 
 tracker
 CS 2022.02.02 14:46
1770 1142 1057 1080 1080 986 846 24 12 11 11 8 7 7 7 6 7 7 7 7 7 7 X X X X
Bugcheck 167 (invalid SEND request)
13
bugs core 5457 
 tracker
 SS 2022.02.02 14:46
749 704 701 682 680 654 533 11 11 7 7 6 6 6 6 8 8 6 8 7 7 7 X X X X
Bugcheck 167 (invalid SEND request)
14
bugs core 5674 
 tracker
 CS 2023.08.12 05:31
17 9 8 5 5 5 5 6 12 12 12 12 8 8 8 8 6 6 6 6 6 6 X X X X
Allow unused Common Table Expressions
15
bugs core 6290 
 tracker
 SS 2022.02.02 14:46
11 10 6 10 6 7 7 10 10 10 10 7 7 6 6 6 6 6 8 8 8 8 X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
16
bugs core 6411 
 tracker
 SS 2023.12.29 06:22
10 10 10 10 10 6 6 6 9 9 9 7 7 7 8 8 8 8 8 8 8 8 X X X X
FB crashes on attempt to create table with number of fields greater than 5460
17
functional intfunc string left 01 
 CS 2022.02.04 18:05
4516 4533 4629 4629 4533 4477 4280 17 11 11 11 9 8 8 7 7 8 7 7 7 7 6 X X X X
LEFT function
18
functional intfunc string left 01 
 SS 2022.02.04 18:05
4087 4195 4300 4300 4147 4147 4054 14 12 11 11 9 9 6 6 9 9 8 8 8 8 8 X X X X
LEFT function
19
functional intfunc string right 01 
 CS 2022.02.04 18:05
4469 4699 4773 4773 4699 4678 4117 11 11 8 9 9 7 7 7 7 7 8 7 7 7 7 X X X X
RIGHT( <string>, <number> )
20
functional intfunc string right 01 
 SS 2022.02.04 18:05
3959 4122 4152 4122 3996 3996 3840 15 12 10 10 8 8 7 7 6 6 6 6 7 8 8 X X X X
RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33806
2025.03.26
b6cfe
3.0.13.33805
2025.03.17
98320
3.0.13.33804
2025.02.25
1439d
3.0.13.33803
2025.01.29
f1848
3.0.13.33802
2025.01.28
650bd
3.0.13.33800
2025.01.20
f20ab
3.0.13.33798
2025.01.16
0c3bb
3.0.13.33795
2024.12.23
1bf0b
3.0.13.33794
2024.10.23
e2a6b
3.0.13.33793
2024.09.02
3e627
3.0.13.33792
2024.08.30
d9f38
3.0.13.33791
2024.08.21
c8a36
3.0.13.33790
2024.08.20
3bf52
3.0.13.33789
2024.08.09
7933a
3.0.12.33787
2024.08.06
bf180
3.0.12.33784
2024.08.01
cd857
3.0.12.33779
2024.07.31
ae35d
3.0.12.33778
2024.07.21
4680d
3.0.12.33777
2024.07.19
8e912
3.0.12.33766
2024.07.13
b5086
3.0.12.33765
2024.07.10
06f2a
3.0.12.33764
2024.06.18
4d0c0
3.0.12.33761
2024.06.17
b259d
3.0.12.33758
2024.06.14
4f9bc
3.0.12.33757
2024.06.13
c7a1c
3.0.12.33744
2024.04.19
ecf36
X X X X
Test TITLE
1
bugs core 0211 
 tracker
 CS 2022.02.02 14:46 725 715 19384 18220 17967 19265 17382 18344 11134 2859 6291 6278 4617 2854 2897 2535 2467 2695 2525 2433 2486 2464 2348 2668 2316 2363 X X X X
SELECT...HAVING...NOT IN crashes server
2
bugs core 0211 
 tracker
 SS 2022.02.02 14:46 415 364 18012 16678 16741 17949 15640 18028 11323 2248 6533 4088 4666 2371 2386 2209 2164 2149 2164 2093 2094 2092 2092 2184 2028 2100 X X X X
SELECT...HAVING...NOT IN crashes server
3
bugs core 0856 
 tracker
 CS 2022.02.02 14:46 867 765 869 849 880 885 775 889 628 5 11 10 10 5 7 7 5 5 6 7 5 5 12 10 8 6 X X X X
Unable to set FName, MName, LName fields in security to blank
4
bugs core 0856 
 tracker
 SS 2022.02.02 14:46 493 447 514 481 436 544 476 419 377 5 10 11 12 6 9 7 6 10 8 9 5 6 7 6 11 7 X X X X
Unable to set FName, MName, LName fields in security to blank
5
bugs core 1363 
 tracker
 CS 2022.02.02 14:46 715 663 831 839 822 904 845 810 616 5 16 11 10 5 9 10 7 12 5 7 11 5 8 7 9 6 X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6
bugs core 1363 
 tracker
 SS 2022.02.02 14:46 355 371 500 494 444 555 481 512 425 6 16 13 10 9 12 7 8 9 9 4 9 6 6 5 7 5 X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7
bugs core 2215 
 tracker
 CS 2022.02.02 14:46 986 871 973 983 1635 1058 995 969 718 8 12 15 9 5 5 5 7 6 5 6 6 7 6 7 16 6 X X X X
GROUP BY concatenation with empty string
8
bugs core 2215 
 tracker
 SS 2022.02.02 14:46 539 549 631 624 658 571 671 609 438 6 13 14 12 10 7 5 8 7 6 8 7 6 11 12 13 5 X X X X
GROUP BY concatenation with empty string
9
bugs core 3479 
 tracker
 CS 2022.02.02 14:46 750 671 1053 1068 1587 1041 968 929 710 6 21 10 11 6 8 5 6 8 7 13 9 7 7 7 14 7 X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10
bugs core 3479 
 tracker
 SS 2022.02.02 14:46 458 419 625 535 566 661 669 594 484 6 10 7 9 9 7 8 8 7 5 8 7 6 7 5 7 7 X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11
bugs core 5270 
 tracker
 CS 2022.02.02 14:46 740 648 6 8 22 7 8 9 9 6 12 32 11 6 10 7 8 9 4 8 10 5 4 13 7 6 X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
12
bugs core 5457 
 tracker
 CS 2022.02.02 14:46 1869 1898 1044 1057 1770 1142 986 1080 846 6 12 24 11 8 7 6 5 7 7 6 7 5 8 9 7 5 X X X X
Bugcheck 167 (invalid SEND request)
13
bugs core 5457 
 tracker
 SS 2022.02.02 14:46 1428 1401 749 701 704 682 680 654 533 5 7 11 16 5 6 5 8 6 9 8 6 6 10 7 15 6 X X X X
Bugcheck 167 (invalid SEND request)
14
bugs core 5674 
 tracker
 CS 2023.08.12 05:31 717 728 8 9 17 5 5 5 6 5 13 12 12 7 8 13 8 6 12 5 6 6 7 5 26 6 X X X X
Allow unused Common Table Expressions
15
bugs core 6290 
 tracker
 SS 2022.02.02 14:46 447 500 5 11 5 10 6 10 5 7 11 10 12 6 7 6 9 6 6 9 6 8 9 5 9 6 X X X X
Hex number used at end of statement (e.g. CREATE DOMAIN ... DEFAULT) may read invalid memory and produce wrong values or exceptions
16
bugs core 6411 
 tracker
 SS 2023.12.29 06:22 16512 16429 7 6 10 10 11 6 5 4 9 10 10 6 7 6 8 9 8 5 8 6 8 17 5 8 X X X X
FB crashes on attempt to create table with number of fields greater than 5460
17
functional intfunc string left 01 
 CS 2022.02.04 18:05 711 765 4516 4673 4533 4629 4683 4477 4280 6 11 17 9 11 8 7 8 5 7 8 9 7 6 4 8 5 X X X X
LEFT function
18
functional intfunc string left 01 
 SS 2022.02.04 18:05 423 442 4195 4342 4087 4300 4911 4147 4054 7 14 12 11 9 5 6 10 5 9 10 8 6 8 8 12 6 X X X X
LEFT function
19
functional intfunc string right 01 
 CS 2022.02.04 18:05 836 724 4469 5383 4699 4773 5678 4678 4117 6 8 11 11 5 9 7 7 11 6 7 8 8 7 4 5 8 X X X X
RIGHT( <string>, <number> )
20
functional intfunc string right 01 
 SS 2022.02.04 18:05 455 474 4234 4122 3959 4933 4152 3996 3840 4 10 15 12 6 8 8 7 6 5 6 7 4 8 8 19 9 X X X X
RIGHT( <string>, <number> )

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-5270
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-5674
http://tracker.firebirdsql.org/browse/CORE-6290
http://tracker.firebirdsql.org/browse/CORE-6411
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
=== end of list ===

Last commits information (all timestamps in UTC):