0. Total results for each kind of outcome and server mode, for previous 30 runs
1. CRASHES/BUGCHECKS: tests that caused Firebird process abend for previous 30 runs (0 rows)
2. FRESH FAILS: tests which failed for LAST execution only (3 rows)
3. FRESH ERRORS: tests which raised runtime error for LAST execution only (10 rows)
4. STILL FAILS: tests which fail for at least TWO LAST runs (7 rows)
5. Has fails: tests with at least one fail for previous 30 runs (64 rows)
[CURRENT] 6. Has runtime errors: tests with at least one runtime error for previous 30 runs (17 rows)
7. FRESH PASSED: successful tests with previous outcome = FAIL/ERROR/SKIPPED or absent (6 rows)
8. All tests: outcomes for previous 30 runs (2343 rows)
9. All tests: durations for previous 30 runs (4576 rows)
A. Skipped: tests which was intentionally excluded from execution (55 rows)

Generated 23.03.2023 02:01
Tested: FB40.   Build: 4.0.3.2913;   SS: 23.03.23 00:02:00 - 23.03.23 00:56:09;   CS: 23.03.23 00:57:45 - 23.03.23 01:59:26;
OS and hardware info:  Linux 4.19.0-5-amd64 #1 SMP Debian 4.19.37-5 (2019-06-19) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.10.9, virtual env; pytest: 7.2.1; firebird.driver: 1.8.0; Firebird.Qa: 0.17.2

Test with at least one result = "ERROR" for last 30 runs:
NN Test name mode 4.0.3.2913
2023-03-23		 4.0.3.2911
2023-03-22		 4.0.3.2909
2023-03-17		 4.0.3.2908
2023-03-14		 4.0.3.2907
2023-03-10		 4.0.3.2906
2023-03-08		 4.0.3.2905
2023-03-04		 4.0.3.2904
2023-03-03		 4.0.3.2903
2023-02-27		 4.0.3.2902
2023-02-18		 4.0.3.2900
2023-02-14		 4.0.3.2899
2023-02-09		 4.0.3.2898
2023-02-08		 4.0.3.2895
2023-02-05		 4.0.3.2891
2023-01-24		 4.0.3.2890
2023-01-17		 4.0.3.2887
2023-01-12		 4.0.3.2885
2023-01-18		 4.0.3.2882
2023-01-18		 4.0.3.2878
2023-01-05		 4.0.3.2873
2023-01-06		 4.0.3.2863
2023-01-03		 X X X X X X X X
Test TITLE
1
bugs core 2668
 tracker
 CS     E     P P P P P P P P P P P P     F     P P P P P P P P X X X X X X X X
Write note into log when automatic sweep is started
2
bugs core 2668
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Write note into log when automatic sweep is started
3
bugs core 3328
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Client writes error messages into firebird.log when database is shutted down
4
bugs core 4731
 tracker
 SS     E     P P P P P     F         F         F         F         F         F         F         F         F         F         F         F         F         F         F         F     X X X X X X X X
Prohibit an ability to issue DML or DDL statements on RDB$ tables
5
bugs core 5146
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Suboptimal join order if one table has a selective predicate and MIN is calculated for the other one
6
bugs core 5648
 tracker
 CS P P     E     P P P P P P P P P P P P P P P P P P P X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
7
bugs core 5648
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
8
bugs core 5667
 tracker
 SS P     E     P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Regression in 3.0+: message CTE 'X' has cyclic dependencies appear when 'X' is alias for resultset and there is previous CTE part with the same name 'X' in the query
9
bugs core 5704
 tracker
 CS P P P P P P P P P P P P P     E     P P P P P P P P X X X X X X X X
Avoid UPDATE of RDB$DATABASE by ALTER DATABASE statement when possible
10
bugs core 5704
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Avoid UPDATE of RDB$DATABASE by ALTER DATABASE statement when possible
11
bugs core 6281
 tracker
 SS     E     P P P P P P P P P P P P P P P P P P P P P X X X X X X X X
Invalid timestamp errors with RDB$TIME_ZONE_UTIL.TRANSITIONS
12
bugs core 6316
 tracker
 CS     E     P P P P P P P P P P P     E         E     P P P P P P P P X X X X X X X X
Unable to specify new 32k page size
13
bugs core 6316
 tracker
 SS P P P P P P P P P P     E     P P P P P P P P P P P X X X X X X X X
Unable to specify new 32k page size
14
bugs gh 7484
 tracker
 SS     E     P P P P P P P X X X X X X X X X X X X X X X X X X X X X X
External engine SYSTEM not found
15
functional domain create 28
 SS P P P P P P P P P P P P P     E     P P P P P P P P X X X X X X X X
CREATE DOMAIN - BLOB SUB TYPE TEXT
16
functional intfunc binary xor 01
 SS P P P P P P P P P P P P     E     P P P P P P P P P X X X X X X X X
New Built-in Functions, Firebird 2.1 : BIN_XOR( <number> [, <number> ...] )
17
functional syspriv change shutdown mode
 CS P P P P P P P P P P P P P     E     P P P P P P P P X X X X X X X X
Check ability to change database shutdown mode by non-sysdba user who is granted with necessary system privileges

Elapsed time, milliseconds:
NN Test name mode median_ms 4.0.3.2913
2023-03-23		 4.0.3.2911
2023-03-22		 4.0.3.2909
2023-03-17		 4.0.3.2908
2023-03-14		 4.0.3.2907
2023-03-10		 4.0.3.2906
2023-03-08		 4.0.3.2905
2023-03-04		 4.0.3.2904
2023-03-03		 4.0.3.2903
2023-02-27		 4.0.3.2902
2023-02-18		 4.0.3.2900
2023-02-14		 4.0.3.2899
2023-02-09		 4.0.3.2898
2023-02-08		 4.0.3.2895
2023-02-05		 4.0.3.2891
2023-01-24		 4.0.3.2890
2023-01-17		 4.0.3.2887
2023-01-12		 4.0.3.2885
2023-01-18		 4.0.3.2882
2023-01-18		 4.0.3.2878
2023-01-05		 4.0.3.2873
2023-01-06		 4.0.3.2863
2023-01-03		 X X X X X X X X
Test TITLE
1
bugs core 2668
 tracker
 CS 5613 116 5565 5486 5501 5476 5529 5550 5542 5569 5539 5658 5668 5751 533 5850 5828 5864 5834 5832 5904 5883 5840 0 0 0 0 0 0 0 0
Write note into log when automatic sweep is started
2
bugs core 2668
 tracker
 SS 6423 93 6375 6399 6325 6353 6334 6324 6335 6361 6354 6495 6495 6508 6484 6423 6424 6442 6433 6447 6449 6440 6480 0 0 0 0 0 0 0 0
Write note into log when automatic sweep is started
3
bugs core 3328
 tracker
 SS 3482 26 4424 3408 3382 3420 3382 3393 3382 3406 3424 3595 3517 3543 3504 3468 3484 3502 3494 3512 3500 3480 3526 0 0 0 0 0 0 0 0
Client writes error messages into firebird.log when database is shutted down
4
bugs core 4731
 tracker
 SS 9282 90 9444 9001 9120 9457 9556 11022 10921 10583 11467 11411 11384 11261 10867 8425 8408 8329 8384 8281 8349 8361 8385 0 0 0 0 0 0 0 0
Prohibit an ability to issue DML or DDL statements on RDB$ tables
5
bugs core 5146
 tracker
 SS 377 63 304 296 276 262 331 311 342 321 300 457 415 449 434 379 385 376 409 390 412 425 418 0 0 0 0 0 0 0 0
Suboptimal join order if one table has a selective predicate and MIN is calculated for the other one
6
bugs core 5648
 tracker
 CS 129925 130872 130275 111 129581 131001 131537 129938 131135 129913 130902 131134 130971 130825 130405 127956 127886 127900 127938 127943 127918 127921 127935 0 0 0 0 0 0 0 0
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
7
bugs core 5648
 tracker
 SS 130383 123 130379 130387 130373 131348 131350 130395 131371 130405 131402 131494 131567 130533 131555 128520 128514 128506 128477 128497 128478 128508 128515 0 0 0 0 0 0 0 0
Avoid serialization of isc_attach_database calls issued by EXECUTE STATEMENT implementation
8
bugs core 5667
 tracker
 SS 372 244 66 252 312 267 270 246 250 272 260 402 432 412 378 392 376 369 406 392 422 387 380 0 0 0 0 0 0 0 0
Regression in 3.0+: message CTE 'X' has cyclic dependencies appear when 'X' is alias for resultset and there is previous CTE part with the same name 'X' in the query
9
bugs core 5704
 tracker
 CS 4503 4456 4396 4379 4400 4403 4386 4432 4407 4432 4415 4602 4588 4550 65 4674 4670 4716 4631 4643 4744 4681 4686 0 0 0 0 0 0 0 0
Avoid UPDATE of RDB$DATABASE by ALTER DATABASE statement when possible
10
bugs core 5704
 tracker
 SS 5333 36 5253 5223 5252 5205 5234 5235 5220 5245 5226 5378 5387 5414 5375 5431 5348 5365 5346 5365 5332 5335 5417 0 0 0 0 0 0 0 0
Avoid UPDATE of RDB$DATABASE by ALTER DATABASE statement when possible
11
bugs core 6281
 tracker
 SS 6 4 300 265 2 0 6 1 10 292 14 6 437 2 1 3 1 391 391 2 1 388 8 0 0 0 0 0 0 0 0
Invalid timestamp errors with RDB$TIME_ZONE_UTIL.TRANSITIONS
12
bugs core 6316
 tracker
 CS 55568 96 54614 55531 53136 53900 53984 55284 56408 55589 55548 54455 56152 137 150 61078 61082 66336 60601 59881 65094 66832 65032 0 0 0 0 0 0 0 0
Unable to specify new 32k page size
13
bugs core 6316
 tracker
 SS 40928 40962 41882 40942 41176 40572 41174 40897 40750 41341 40914 58 41762 41943 41000 39586 38988 40612 39255 38856 43748 40879 41365 0 0 0 0 0 0 0 0
Unable to specify new 32k page size
14
bugs gh 7484
 tracker
 SS 271 311 281 274 295 233 228 221 269 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
External engine SYSTEM not found
15
functional domain create 28
 SS 335 251 265 303 298 287 294 300 254 281 290 431 402 419 182 418 386 400 375 370 379 367 372 0 0 0 0 0 0 0 0
CREATE DOMAIN - BLOB SUB TYPE TEXT
16
functional intfunc binary xor 01
 SS 337 280 289 278 265 252 310 265 287 263 311 372 420 178 407 381 364 382 408 389 376 395 404 0 0 0 0 0 0 0 0
New Built-in Functions, Firebird 2.1 : BIN_XOR( <number> [, <number> ...] )
17
functional syspriv change shutdown mode
 CS 2598 2619 2503 2560 2455 2550 2452 2589 2552 2727 2537 2709 2799 2771 244 2719 2536 2790 2511 2608 2783 2918 2857 0 0 0 0 0 0 0 0
Check ability to change database shutdown mode by non-sysdba user who is granted with necessary system privileges

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2668
http://tracker.firebirdsql.org/browse/core-3328
http://tracker.firebirdsql.org/browse/core-4731
http://tracker.firebirdsql.org/browse/core-5146
http://tracker.firebirdsql.org/browse/core-5648
http://tracker.firebirdsql.org/browse/core-5667
http://tracker.firebirdsql.org/browse/core-5704
http://tracker.firebirdsql.org/browse/core-6281
http://tracker.firebirdsql.org/browse/core-6316
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_28.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/intfunc/binary/test_xor_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_change_shutdown_mode.py
https://github.com/FirebirdSQL/firebird/issues/7484

=== end of list ===