01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (2 rows)
[CURRENT] 06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (18 rows)
07. Has fails: tests with at least one fail for previous 30 runs (10 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2005 rows)
12. Skipped: tests which was intentionally excluded from execution (65 rows)

Generated UTC 22.02.2025 08:28
Tested: FB30.   Build / date: 3.0.13.33803-f1848484 / 2025.01.29;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Performance slowdown for more than 5 recent runs - moving medians

At least 2 recent moving medians (window = 5) greater than "normal" for at least 1.5x. No more than 50 rows are shown, pre-filtered in descending order of ratio between latest and "normal" medians:
NN Test name mode Test last update Moving medians chart
3.0.13.33803
2025.01.29
3.0.13.33802
2025.01.28
3.0.13.33800
2025.01.20
3.0.13.33798
2025.01.16
3.0.13.33795
2024.12.23
3.0.13.33794
2024.10.23
3.0.13.33793
2024.09.02
3.0.13.33792
2024.08.30
3.0.13.33791
2024.08.21
3.0.13.33790
2024.08.20
3.0.13.33789
2024.08.09
3.0.12.33787
2024.08.06
3.0.12.33784
2024.08.01
3.0.12.33779
2024.07.31
3.0.12.33778
2024.07.21
3.0.12.33777
2024.07.19
3.0.12.33766
2024.07.13
3.0.12.33765
2024.07.10
3.0.12.33764
2024.06.18
3.0.12.33761
2024.06.17
3.0.12.33758
2024.06.14
3.0.12.33757
2024.06.13
3.0.12.33744
2024.04.19
X X X
Test TITLE
1 CS 2022.02.02 14:46
18344 17967 17382 11134 6291 6278 4617 4617 2897 2854 2695 2535 2525 2486 2486 2464 2464 2464 2363 X X X X X X X
SELECT...HAVING...NOT IN crashes server
2 SS 2022.02.02 14:46
17949 16741 15640 11323 6533 4666 4088 4088 2386 2371 2209 2164 2164 2149 2094 2093 2093 2092 2092 X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 CS 2022.02.02 14:46
880 880 775 628 11 10 10 10 7 7 5 6 6 5 5 6 7 8 8 X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4 SS 2022.02.02 14:46
476 436 419 377 11 11 10 10 9 7 7 8 8 8 8 7 6 6 7 X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 CS 2022.02.02 14:46
845 822 810 616 16 11 10 10 10 9 9 9 7 7 7 7 7 8 7 X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 SS 2022.02.02 14:46
496 481 481 425 16 13 10 12 10 9 9 9 8 9 9 6 6 6 6 X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 CS 2022.02.02 14:46
995 995 969 718 15 12 9 9 5 5 5 5 6 6 6 6 6 7 7 X X X X X X X
GROUP BY concatenation with empty string
8 SS 2022.02.02 14:46
645 609 571 438 14 13 12 12 10 8 7 7 7 7 7 7 8 11 11 X X X X X X X
GROUP BY concatenation with empty string
9 CS 2022.02.02 14:46
968 968 929 710 21 11 10 10 8 6 6 7 7 8 8 7 7 7 7 X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10 SS 2022.02.02 14:46
649 594 594 484 10 9 9 9 8 8 8 7 8 7 7 7 7 7 7 X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11 CS 2022.02.02 14:46
8 9 8 9 9 11 11 11 10 8 8 8 8 8 8 5 8 7 6 X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
12 CS 2022.02.02 14:46
1131 1080 986 846 24 12 11 11 8 7 7 7 6 7 7 7 7 7 7 X X X X X X X
Bugcheck 167 (invalid SEND request)
13 SS 2022.02.02 14:46
680 680 654 533 11 11 7 7 6 6 6 6 8 8 6 8 7 7 7 X X X X X X X
Bugcheck 167 (invalid SEND request)
14 SS 2023.12.29 06:22
10 10 6 6 6 9 9 9 7 7 7 8 8 8 8 8 8 8 8 X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
15 CS 2022.02.04 18:05
4556 4533 4477 4280 17 11 11 11 9 8 8 7 7 8 7 7 7 7 6 X X X X X X X
LEFT function
16 SS 2022.02.04 18:05
4258 4147 4147 4054 14 12 11 11 9 9 6 6 9 9 8 8 8 8 8 X X X X X X X
LEFT function
17 CS 2022.02.04 18:05
4699 4699 4678 4117 11 11 8 9 9 7 7 7 7 7 8 7 7 7 7 X X X X X X X
RIGHT( <string>, <number> )
18 SS 2022.02.04 18:05
4152 3996 3996 3840 15 12 10 10 8 8 7 7 6 6 6 6 7 8 8 X X X X X X X
RIGHT( <string>, <number> )

Elapsed time, milliseconds:

NN Test name mode Test last update
3.0.13.33803
2025.01.29
3.0.13.33802
2025.01.28
3.0.13.33800
2025.01.20
3.0.13.33798
2025.01.16
3.0.13.33795
2024.12.23
3.0.13.33794
2024.10.23
3.0.13.33793
2024.09.02
3.0.13.33792
2024.08.30
3.0.13.33791
2024.08.21
3.0.13.33790
2024.08.20
3.0.13.33789
2024.08.09
3.0.12.33787
2024.08.06
3.0.12.33784
2024.08.01
3.0.12.33779
2024.07.31
3.0.12.33778
2024.07.21
3.0.12.33777
2024.07.19
3.0.12.33766
2024.07.13
3.0.12.33765
2024.07.10
3.0.12.33764
2024.06.18
3.0.12.33761
2024.06.17
3.0.12.33758
2024.06.14
3.0.12.33757
2024.06.13
3.0.12.33744
2024.04.19
X X X X X X X
Test TITLE
1 CS 2022.02.02 14:46 19576 17967 19265 17382 18344 11134 2859 6291 6278 4617 2854 2897 2535 2467 2695 2525 2433 2486 2464 2348 2668 2316 2363 X X X X X X X
SELECT...HAVING...NOT IN crashes server
2 SS 2022.02.02 14:46 18875 16741 17949 15640 18028 11323 2248 6533 4088 4666 2371 2386 2209 2164 2149 2164 2093 2094 2092 2092 2184 2028 2100 X X X X X X X
SELECT...HAVING...NOT IN crashes server
3 CS 2022.02.02 14:46 827 880 885 775 889 628 5 11 10 10 5 7 7 5 5 6 7 5 5 12 10 8 6 X X X X X X X
Unable to set FName, MName, LName fields in security to blank
4 SS 2022.02.02 14:46 481 436 544 476 419 377 5 10 11 12 6 9 7 6 10 8 9 5 6 7 6 11 7 X X X X X X X
Unable to set FName, MName, LName fields in security to blank
5 CS 2022.02.02 14:46 903 822 904 845 810 616 5 16 11 10 5 9 10 7 12 5 7 11 5 8 7 9 6 X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
6 SS 2022.02.02 14:46 496 444 555 481 512 425 6 16 13 10 9 12 7 8 9 9 4 9 6 6 5 7 5 X X X X X X X
ISQL crash when converted-from-double string longer than 23 bytes
7 CS 2022.02.02 14:46 985 1635 1058 995 969 718 8 12 15 9 5 5 5 7 6 5 6 6 7 6 7 16 6 X X X X X X X
GROUP BY concatenation with empty string
8 SS 2022.02.02 14:46 645 658 571 671 609 438 6 13 14 12 10 7 5 8 7 6 8 7 6 11 12 13 5 X X X X X X X
GROUP BY concatenation with empty string
9 CS 2022.02.02 14:46 954 1587 1041 968 929 710 6 21 10 11 6 8 5 6 8 7 13 9 7 7 7 14 7 X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
10 SS 2022.02.02 14:46 649 566 661 669 594 484 6 10 7 9 9 7 8 8 7 5 8 7 6 7 5 7 7 X X X X X X X
ASCII_VAL raises error instead of return 0 for empty strings
11 CS 2022.02.02 14:46 8 22 7 8 9 9 6 12 32 11 6 10 7 8 9 4 8 10 5 4 13 7 6 X X X X X X X
FBSVCMGR does not produce error while attempting to shutdown a database without specified timeout (prp_force_shutdown N)
12 CS 2022.02.02 14:46 1131 1770 1142 986 1080 846 6 12 24 11 8 7 6 5 7 7 6 7 5 8 9 7 5 X X X X X X X
Bugcheck 167 (invalid SEND request)
13 SS 2022.02.02 14:46 648 704 682 680 654 533 5 7 11 16 5 6 5 8 6 9 8 6 6 10 7 15 6 X X X X X X X
Bugcheck 167 (invalid SEND request)
14 SS 2023.12.29 06:22 10 10 10 11 6 5 4 9 10 10 6 7 6 8 9 8 5 8 6 8 17 5 8 X X X X X X X
FB crashes on attempt to create table with number of fields greater than 5460
15 CS 2022.02.04 18:05 4556 4533 4629 4683 4477 4280 6 11 17 9 11 8 7 8 5 7 8 9 7 6 4 8 5 X X X X X X X
LEFT function
16 SS 2022.02.04 18:05 4258 4087 4300 4911 4147 4054 7 14 12 11 9 5 6 10 5 9 10 8 6 8 8 12 6 X X X X X X X
LEFT function
17 CS 2022.02.04 18:05 4594 4699 4773 5678 4678 4117 6 8 11 11 5 9 7 7 11 6 7 8 8 7 4 5 8 X X X X X X X
RIGHT( <string>, <number> )
18 SS 2022.02.04 18:05 4202 3959 4933 4152 3996 3840 4 10 15 12 6 8 8 7 6 5 6 7 4 8 8 19 9 X X X X X X X
RIGHT( <string>, <number> )

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1363
http://tracker.firebirdsql.org/browse/CORE-211
http://tracker.firebirdsql.org/browse/CORE-2215
http://tracker.firebirdsql.org/browse/CORE-3479
http://tracker.firebirdsql.org/browse/CORE-5270
http://tracker.firebirdsql.org/browse/CORE-5457
http://tracker.firebirdsql.org/browse/CORE-6411
http://tracker.firebirdsql.org/browse/CORE-856
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_left_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/string/test_right_01.py
=== end of list ===

Last commits information (all timestamps in UTC):