01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (3 rows)
[CURRENT] 03. NEW FAILS: tests which failed for LAST run (25 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (9 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (6 rows)
06. Has fails: tests with at least one fail for previous 30 runs (93 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (15 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (3 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2062 rows)
11. All tests: durations for previous 30 runs (3974 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 12.05.2024 19:14
Tested: HQ30.   Build: 3.0.12.33744;   SS: 12.05.24 17:42:19 - 12.05.24 18:16:50;   CS: 12.05.24 18:17:31 - 12.05.24 19:11:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests with result = "FAIL" for last run:

NN Test name mode 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0606 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Tricky role defeats basic SQL security
2
bugs core 0885 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
It is impossible to take away rights on update of a column
3
bugs core 2233 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
4
bugs core 2940 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Trace output could contain garbage data left from filtered out statements
5
bugs core 3008 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Add attachment's CHARACTER SET name into corresponding trace records
6
bugs core 3168 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
exclude_filter doesn't work for <services></section> section of the Trace facility
7
bugs core 3413 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Improve diagnostics of internal trace errors
8
bugs core 3537 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
There is no need to undo changes made in GTT created with ON COMMIT DELETE ROWS option when transaction is rolled back
9
bugs core 3598 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
TRACE: add statistics of actions that were after transaction finished
10
bugs core 4094 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Wrong parameters order in trace output
11
bugs core 4298 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
fbsvcmgr doesn't recognise sts_record_versions and other sts switches
12
bugs core 4326 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Keyword SET should not be required in ALTER USER statement
13
bugs core 4337 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
14
bugs core 4359 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
non-priviledged user can insert and update rdb$database
15
bugs core 4451 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Allow output to trace explain plan form.
16
bugs core 4468 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
FB3: CREATE USER GRANT ADMIN ROLE does not work
17
bugs core 4811 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Make user names behave according to SQL identifiers rules
18
bugs core 5435 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Badly selective index could be used for extra filtering even if selective index is used for sorting
19
bugs core 5489 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Bad performance for NULLs filtering inside a navigational index scan
20
bugs core 5754 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
ALTER TRIGGER check privilege for alter database instead of table
21
bugs core 5985 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Regression: ROLE does not passed in ES/EDS (specifying it in the statement is ignored)
22
bugs core 5995 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Creator user name is empty in user trace sessions
23
bugs core 6038 
 tracker
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
Srp user manager sporadically creates users which can not attach Explanation of bug nature was provided by Alex, see letter 05-jun-19 13:51. Some iteration failed with probability equal to occurence of 0 (zero) in the highest BYTE of some number. Byte is 8 bit ==> this probability is 1/256. Given 'N_LIMIT' is number of iterations, probability of success for ALL of them is 7.5%, and when N_LIMIT is 1000 then p = 0.004%. Because of time (speed) it was decided to run only 256 iterations. If bug will be 'raised' somewhere then this number is enough to catch it after 2-3 times of test run. Reproduced on WI-V3.0.5.33118, date: 11-apr-19 (got fails not late than on 250th iteration). Works fine on WI-V3.0.5.33139, date: 04-apr-19.
24
functional arno optimizer opt sort by index 08 
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
MIN() and DESC index (non-unique)
25
functional gtcs gtcs proc isql 16 
 CS F P P P P P P P P P P P P P P X X X X X X X X X X X X X X X
gtcs-proc-isql-16

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 0606 
 tracker
 CS 2329 3234 2958 2329 2820 2350 2201 2409 2227 2246 2108 2259 2375 2109 2464 1979 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Tricky role defeats basic SQL security
2
bugs core 0885 
 tracker
 CS 2990 3952 3645 2994 3585 2972 2914 3010 2991 2876 2643 2946 2990 2678 3115 2451 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
It is impossible to take away rights on update of a column
3
bugs core 2233 
 tracker
 CS 3441 4313 4105 3494 4042 3441 3462 3667 3317 3461 3055 3302 3364 3069 3420 2847 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow non-SYSDBA users to monitor not only their current attachment but other their attachments as well
4
bugs core 2940 
 tracker
 CS 2955 3131 3077 2959 3113 2947 2912 2976 2955 2956 2890 2911 2922 2919 3109 2750 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace output could contain garbage data left from filtered out statements
5
bugs core 3008 
 tracker
 CS 2959 3413 3097 2956 3292 2959 2968 2925 2967 2949 2903 2880 2936 2950 3099 3032 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Add attachment's CHARACTER SET name into corresponding trace records
6
bugs core 3168 
 tracker
 CS 2951 3136 3121 2983 3150 3037 2951 2976 2952 2730 2647 2687 2923 2613 2874 2757 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
exclude_filter doesn't work for <services></section> section of the Trace facility
7
bugs core 3413 
 tracker
 CS 2955 3098 3093 2960 3046 2915 2935 2973 2955 2905 2637 2895 2917 2905 3120 3049 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Improve diagnostics of internal trace errors
8
bugs core 3537 
 tracker
 CS 5149 5636 5444 5222 6065 5325 5325 5149 5121 5293 4837 4840 4908 4844 5025 4502 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
There is no need to undo changes made in GTT created with ON COMMIT DELETE ROWS option when transaction is rolled back
9
bugs core 3598 
 tracker
 CS 3170 3429 3375 3208 3256 3168 3196 3157 3187 3163 3118 3149 3170 3133 3280 2968 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
TRACE: add statistics of actions that were after transaction finished
10
bugs core 4094 
 tracker
 CS 3169 3393 3299 3175 3264 3165 3198 3169 3138 3198 3078 3123 3115 3153 3301 2952 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Wrong parameters order in trace output
11
bugs core 4298 
 tracker
 CS 894 1260 1107 894 1017 926 931 904 862 875 750 799 820 743 1025 848 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
fbsvcmgr doesn't recognise sts_record_versions and other sts switches
12
bugs core 4326 
 tracker
 CS 1655 1893 1754 1655 1984 1619 1718 1718 1712 1534 1478 1565 1592 1461 1831 1538 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Keyword SET should not be required in ALTER USER statement
13
bugs core 4337 
 tracker
 CS 13529 14588 13386 13361 16151 14023 13997 13529 13436 13760 13593 13476 13736 13283 13403 12060 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gfix -sweep makes "reconnect" when it is removed from mon$attachments by delete command (issued in another window)
14
bugs core 4359 
 tracker
 CS 1381 1750 1710 1381 1711 1362 1410 1443 1382 1373 1244 1345 1338 1215 1544 1264 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
non-priviledged user can insert and update rdb$database
15
bugs core 4451 
 tracker
 CS 3187 3419 3290 3196 3334 3187 3193 3215 3164 3175 3068 3108 3116 3061 3240 2929 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Allow output to trace explain plan form.
16
bugs core 4468 
 tracker
 CS 1985 2814 2215 1914 2412 1914 1963 2032 1985 2111 1671 1925 2097 1840 2301 1854 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
FB3: CREATE USER GRANT ADMIN ROLE does not work
17
bugs core 4811 
 tracker
 CS 3111 4101 4078 3376 3848 3012 3158 3263 3111 3070 2699 2944 3013 2773 3189 2491 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make user names behave according to SQL identifiers rules
18
bugs core 5435 
 tracker
 CS 4440 4547 4382 4591 4810 4418 4382 4668 4681 4754 4440 4294 4331 4313 4446 4121 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Badly selective index could be used for extra filtering even if selective index is used for sorting
19
bugs core 5489 
 tracker
 CS 4472 4633 4376 4356 4691 4630 4472 4597 4622 4717 4301 4213 4294 4376 4541 3780 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Bad performance for NULLs filtering inside a navigational index scan
20
bugs core 5754 
 tracker
 CS 859 859 1032 859 929 843 864 963 799 863 747 828 816 704 1024 828 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ALTER TRIGGER check privilege for alter database instead of table
21
bugs core 5985 
 tracker
 CS 2349 3016 2795 2433 2909 2386 2312 2349 2484 2295 2040 2212 2267 2131 2512 1942 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: ROLE does not passed in ES/EDS (specifying it in the statement is ignored)
22
bugs core 5995 
 tracker
 CS 2728 2872 2803 2696 3052 2930 2762 2669 2963 2642 2647 2663 2671 2651 2912 2728 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Creator user name is empty in user trace sessions
23
bugs core 6038 
 tracker
 CS 169699 830 214958 174617 200810 171768 170264 178116 174672 169699 152160 164337 169250 156625 168600 130997 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Srp user manager sporadically creates users which can not attach Explanation of bug nature was provided by Alex, see letter 05-jun-19 13:51. Some iteration failed with probability equal to occurence of 0 (zero) in the highest BYTE of some number. Byte is 8 bit ==> this probability is 1/256. Given 'N_LIMIT' is number of iterations, probability of success for ALL of them is 7.5%, and when N_LIMIT is 1000 then p = 0.004%. Because of time (speed) it was decided to run only 256 iterations. If bug will be 'raised' somewhere then this number is enough to catch it after 2-3 times of test run. Reproduced on WI-V3.0.5.33118, date: 11-apr-19 (got fails not late than on 250th iteration). Works fine on WI-V3.0.5.33139, date: 04-apr-19.
24
functional arno optimizer opt sort by index 08 
 CS 781 870 906 807 927 786 852 739 766 767 643 689 781 690 878 765 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
MIN() and DESC index (non-unique)
25
functional gtcs gtcs proc isql 16 
 CS 1338 1717 1620 1339 1545 1342 1419 1335 1352 1338 1161 1217 1181 1143 1164 992 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
gtcs-proc-isql-16

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2233
http://tracker.firebirdsql.org/browse/core-2940
http://tracker.firebirdsql.org/browse/core-3008
http://tracker.firebirdsql.org/browse/core-3168
http://tracker.firebirdsql.org/browse/core-3413
http://tracker.firebirdsql.org/browse/core-3537
http://tracker.firebirdsql.org/browse/core-3598
http://tracker.firebirdsql.org/browse/core-4094
http://tracker.firebirdsql.org/browse/core-4298
http://tracker.firebirdsql.org/browse/core-4326
http://tracker.firebirdsql.org/browse/core-4337
http://tracker.firebirdsql.org/browse/core-4359
http://tracker.firebirdsql.org/browse/core-4451
http://tracker.firebirdsql.org/browse/core-4468
http://tracker.firebirdsql.org/browse/core-4811
http://tracker.firebirdsql.org/browse/core-5435
http://tracker.firebirdsql.org/browse/core-5489
http://tracker.firebirdsql.org/browse/core-5754
http://tracker.firebirdsql.org/browse/core-5985
http://tracker.firebirdsql.org/browse/core-5995
http://tracker.firebirdsql.org/browse/core-6038
http://tracker.firebirdsql.org/browse/core-606
http://tracker.firebirdsql.org/browse/core-885
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_08.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/gtcs/test_gtcs_proc_isql_16.py

=== end of list ===