01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (3 rows)
03. NEW FAILS: tests which failed for LAST run (25 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (9 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (6 rows)
06. Has fails: tests with at least one fail for previous 30 runs (93 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (15 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (3 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (5 rows)
10. All tests: outcomes for previous 30 runs (2062 rows)
11. All tests: durations for previous 30 runs (3974 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 12.05.2024 19:14
Tested: HQ30.   Build: 3.0.12.33744;   SS: 12.05.24 17:42:19 - 12.05.24 18:16:50;   CS: 12.05.24 18:17:31 - 12.05.24 19:11:55;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

NN Test name mode 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 1292 
 tracker
 SS F F F F F F F F F F F F F F F X X X X X X X X X X X X X X X
Can't create table using long username and UTF8 as attachment charset
2
bugs core 4880 
 tracker
 SS F F F P F F P P P F F F F F F X X X X X X X X X X X X X X X
Better performance of creating packages containing many functions
3
bugs core 5602 
 tracker
 CS F F P P P P P P P P P P P X X X X X X X X X X X X X X X X X
Slow changes on domain
4
bugs core 5602 
 tracker
 SS F F P P P P P P P P P P P X X X X X X X X X X X X X X X X X
Slow changes on domain
5
bugs core 6108 
 tracker
 CS F F F F F F F F F F F F F F F X X X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
6
bugs core 6108 
 tracker
 SS F F F F F F F F F F F F F F F X X X X X X X X X X X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33744
2024-05-12		 3.0.12.33740
2024-04-20		 3.0.12.33726
2024-04-04		 3.0.12.33725
2023-12-29		 3.0.12.33722
2023-11-28		 3.0.12.33712
2023-11-07		 3.0.12.33706
2023-09-20		 3.0.11.33689
2023-08-09		 3.0.11.33687
2023-06-22		 3.0.11.33685
2023-06-04		 3.0.11.33683
2023-05-02		 3.0.11.33666
2023-04-17		 3.0.11.33664
2023-03-14		 3.0.11.33657
2023-02-08		 3.0.11.33648
2023-01-18		 X X X X X X X X X X X X X X X
Test TITLE
1
bugs core 1292 
 tracker
 SS 432 464 432 395 470 398 436 453 408 406 377 360 441 437 536 405 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Can't create table using long username and UTF8 as attachment charset
2
bugs core 4880 
 tracker
 SS 178724 155713 141009 155680 199542 176102 181437 193014 192599 187706 166446 178724 185588 179258 175770 114084 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Better performance of creating packages containing many functions
3
bugs core 5602 
 tracker
 CS 11418 20231 18523 10874 12354 11079 10842 13294 12403 13403 10797 10076 11418 10927 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
4
bugs core 5602 
 tracker
 SS 9807 16905 16190 9418 11730 9700 9534 11309 11221 12011 9807 9138 9426 9778 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
5
bugs core 6108 
 tracker
 CS 500 691 653 483 542 474 508 500 500 461 443 435 455 483 656 529 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
6
bugs core 6108 
 tracker
 SS 222 259 222 203 292 199 236 213 222 255 175 227 219 217 299 271 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-4880
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-6108

=== end of list ===