01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (8 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (1988 rows)
11. All tests: durations for previous 30 runs (3858 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated 22.02.2024 07:44
Tested: FB30.   Build: 3.0.12.33731;   SS: 22.02.24 06:21:05 - 22.02.24 06:54:59;   CS: 22.02.24 06:55:55 - 22.02.24 07:42:48;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 3.0.12.33731
2024-02-22
3.0.12.33730
2024-02-13
3.0.12.33729
2024-02-06
3.0.12.33728
2024-01-30
3.0.12.33727
2024-01-24
3.0.12.33726
2024-01-16
3.0.12.33725
2023-12-12
3.0.12.33724
2023-11-25
3.0.12.33723
2023-11-16
3.0.12.33722
2023-11-13
3.0.12.33721
2023-11-07
3.0.12.33720
2023-11-02
3.0.12.33718
2023-10-28
3.0.12.33717
2023-10-24
3.0.12.33715
2023-10-05
3.0.12.33713
2023-09-29
3.0.12.33712
2023-09-20
3.0.12.33711
2023-09-14
3.0.12.33710
2023-09-07
3.0.12.33709
2023-09-06
3.0.12.33707
2023-08-25
3.0.12.33706
2023-08-10
3.0.12.33705
2023-08-06
3.0.11.33704
2023-08-04
3.0.11.33703
2023-07-31
3.0.11.33702
2023-07-30
3.0.11.33698
2023-07-29
3.0.11.33696
2023-07-20
3.0.11.33695
2023-07-19
3.0.11.33692
2023-07-08
Test TITLE
1 CS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Roles granting/revoking logic
2 SS P P P P P P P P P P P P P P P P P P F P P P P F P P P P P F
Client receive event's with count equal to 1 despite of how many times EVENT was POSTed in same transaction
3 CS P P P P P P P P P P P P P P P P P P F P P P P P P P P P P P
page 0 is of wrong type (expected 6, found 1)
4 CS P P P P F P P P P P P P P P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 CS P P P P P P P P P P P P P P P P P P P P P F F F F F F F F F
Allow unused Common Table Expressions
6 SS P P P P P P P P P P P P P P P P P P P P P F F F F F F F F F
Allow unused Common Table Expressions
7 CS X X X X X X X X X X X X X X X X X X X X X F F F F F F F F X
Cursor name can duplicate parameter and variable names in procedures and functions
8 SS X X X X X X X X X X X X X X X X X X X X X F F F F F F F F X
Cursor name can duplicate parameter and variable names in procedures and functions

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33731
2024-02-22
3.0.12.33730
2024-02-13
3.0.12.33729
2024-02-06
3.0.12.33728
2024-01-30
3.0.12.33727
2024-01-24
3.0.12.33726
2024-01-16
3.0.12.33725
2023-12-12
3.0.12.33724
2023-11-25
3.0.12.33723
2023-11-16
3.0.12.33722
2023-11-13
3.0.12.33721
2023-11-07
3.0.12.33720
2023-11-02
3.0.12.33718
2023-10-28
3.0.12.33717
2023-10-24
3.0.12.33715
2023-10-05
3.0.12.33713
2023-09-29
3.0.12.33712
2023-09-20
3.0.12.33711
2023-09-14
3.0.12.33710
2023-09-07
3.0.12.33709
2023-09-06
3.0.12.33707
2023-08-25
3.0.12.33706
2023-08-10
3.0.12.33705
2023-08-06
3.0.11.33704
2023-08-04
3.0.11.33703
2023-07-31
3.0.11.33702
2023-07-30
3.0.11.33698
2023-07-29
3.0.11.33696
2023-07-20
3.0.11.33695
2023-07-19
3.0.11.33692
2023-07-08
Test TITLE
1 CS 1779 2023 2143 2120 2039 2118 2323 1811 1743 1780 1779 1775 1796 1832 1537 1472 1384 1892 1897 1789 1921 1726 1785 1770 1664 1694 1682 1705 1762 1676 1648
Roles granting/revoking logic
2 SS 1294 1330 1351 1391 1325 1307 1554 1336 1346 1323 1373 1296 1293 1341 1266 236 234 247 303 10322 313 291 287 268 10460 282 306 294 302 301 10416
Client receive event's with count equal to 1 despite of how many times EVENT was POSTed in same transaction
3 CS 523 676 584 597 582 559 838 527 530 518 525 509 530 517 458 434 407 577 517 572 549 480 450 504 523 525 466 524 515 521 474
page 0 is of wrong type (expected 6, found 1)
4 CS 641 2526 750 786 698 768 906 706 703 698 643 719 736 659 567 488 548 611 601 690 639 535 584 636 635 624 582 583 647 630 555
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
5 CS 419 462 557 521 497 447 815 478 409 420 432 427 418 434 403 316 341 379 442 436 443 395 404 376 370 387 409 431 419 395 373
Allow unused Common Table Expressions
6 SS 273 273 278 268 320 313 434 273 263 275 277 309 294 283 226 205 213 254 271 273 258 258 259 278 393 257 227 249 262 276 334
Allow unused Common Table Expressions
7 CS 429 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 484 443 416 433 410 426 442 412 0
Cursor name can duplicate parameter and variable names in procedures and functions
8 SS 293 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 320 302 523 293 293 283 258 281 0
Cursor name can duplicate parameter and variable names in procedures and functions

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1869
http://tracker.firebirdsql.org/browse/core-3095
http://tracker.firebirdsql.org/browse/core-3188
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5674
https://github.com/FirebirdSQL/firebird/issues/7670

=== end of list ===