01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (1 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (12 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (1991 rows)
11. All tests: durations for previous 30 runs (3858 rows)
12. Skipped: tests which was intentionally excluded from execution (66 rows)

Generated 18.03.2024 06:59
Tested: FB30.   Build: 3.0.12.33736;   SS: 18.03.24 05:48:27 - 18.03.24 06:17:50;   CS: 18.03.24 06:18:42 - 18.03.24 06:58:13;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.7, virtual env; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 3.0.12.33736
2024-03-18
3.0.12.33735
2024-03-15
3.0.12.33734
2024-03-08
3.0.12.33731
2024-02-29
3.0.12.33730
2024-02-13
3.0.12.33729
2024-02-06
3.0.12.33728
2024-01-30
3.0.12.33727
2024-01-24
3.0.12.33726
2024-01-16
3.0.12.33725
2023-12-12
3.0.12.33724
2023-11-25
3.0.12.33723
2023-11-16
3.0.12.33722
2023-11-13
3.0.12.33721
2023-11-07
3.0.12.33720
2023-11-02
3.0.12.33718
2023-10-28
3.0.12.33717
2023-10-24
3.0.12.33715
2023-10-05
3.0.12.33713
2023-09-29
3.0.12.33712
2023-09-20
3.0.12.33711
2023-09-14
3.0.12.33710
2023-09-07
3.0.12.33709
2023-09-06
3.0.12.33707
2023-08-25
3.0.12.33706
2023-08-10
3.0.12.33705
2023-08-06
3.0.11.33704
2023-08-04
3.0.11.33703
2023-07-31
3.0.11.33702
2023-07-30
3.0.11.33698
2023-07-29
Test TITLE
1 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Roles granting/revoking logic
2 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Sweep could raise error : page 0 is of wrong type (expected 6, found 1)
3 SS P P P P P P P P P P P P P P P P P P P P P F P P P P F P P P
Client receive event's with count equal to 1 despite of how many times EVENT was POSTed in same transaction
4 CS P P P P P P P P P P P P P P P P P P P P P F P P P P P P P P
page 0 is of wrong type (expected 6, found 1)
5 CS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
6 CS P P P P P P P F P P P P P P P P P P P P P P P P P P P P P P
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Slow changes on domain
8 SS F F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Slow changes on domain
9 CS P P P P P P P P P P P P P P P P P P P P P P P P F F F F F F
Allow unused Common Table Expressions
10 SS P P P P P P P P P P P P P P P P P P P P P P P P F F F F F F
Allow unused Common Table Expressions
11 CS X X X X X X X X X X X X X X X X X X X X X X X X F F F F F F
Cursor name can duplicate parameter and variable names in procedures and functions
12 SS X X X X X X X X X X X X X X X X X X X X X X X X F F F F F F
Cursor name can duplicate parameter and variable names in procedures and functions

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33736
2024-03-18
3.0.12.33735
2024-03-15
3.0.12.33734
2024-03-08
3.0.12.33731
2024-02-29
3.0.12.33730
2024-02-13
3.0.12.33729
2024-02-06
3.0.12.33728
2024-01-30
3.0.12.33727
2024-01-24
3.0.12.33726
2024-01-16
3.0.12.33725
2023-12-12
3.0.12.33724
2023-11-25
3.0.12.33723
2023-11-16
3.0.12.33722
2023-11-13
3.0.12.33721
2023-11-07
3.0.12.33720
2023-11-02
3.0.12.33718
2023-10-28
3.0.12.33717
2023-10-24
3.0.12.33715
2023-10-05
3.0.12.33713
2023-09-29
3.0.12.33712
2023-09-20
3.0.12.33711
2023-09-14
3.0.12.33710
2023-09-07
3.0.12.33709
2023-09-06
3.0.12.33707
2023-08-25
3.0.12.33706
2023-08-10
3.0.12.33705
2023-08-06
3.0.11.33704
2023-08-04
3.0.11.33703
2023-07-31
3.0.11.33702
2023-07-30
3.0.11.33698
2023-07-29
Test TITLE
1 CS 1779 1571 1653 1485 2339 2143 2120 2039 2118 2323 1811 1743 1780 1779 1775 1796 1832 1537 1472 1384 1892 1897 1789 1921 1726 1785 1770 1664 1694 1682 1705
Roles granting/revoking logic
2 CS 2522 2509 2480 2468 2799 2642 2590 2594 2538 2738 2475 2474 2539 2501 2553 2531 2481 2406 2431 2418 2548 2490 2542 2524 2506 2521 2504 2524 2526 2559 2492
Sweep could raise error : page 0 is of wrong type (expected 6, found 1)
3 SS 1294 1298 1275 1270 1358 1351 1391 1325 1307 1554 1336 1346 1323 1373 1296 1293 1341 1266 236 234 247 303 10322 313 291 287 268 10460 282 306 294
Client receive event's with count equal to 1 despite of how many times EVENT was POSTed in same transaction
4 CS 523 497 485 458 701 584 597 582 559 838 527 530 518 525 509 530 517 458 434 407 577 517 572 549 480 450 504 523 525 466 524
page 0 is of wrong type (expected 6, found 1)
5 CS 5926 1476 5930 5843 6155 6119 6007 6082 5994 6259 5977 5933 5923 5979 5944 5929 5975 5790 5722 5731 5834 5869 5853 5965 5938 5917 5893 5872 5912 5800 5881
Firebird 3.0 + fbclient 3.0 - POST_EVENT won't work
6 CS 674 2242 2194 2184 2584 750 786 698 768 906 706 703 698 643 719 736 659 567 488 548 611 601 690 639 535 584 636 635 624 582 583
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS 11625 18237 18051 9623 14123 13201 11630 11040 11847 12085 11997 9814 10311 10861 9857 9798 10103 9685 9327 9498 11058 12715 11620 12448 10812 11460 12974 12768 12460 13407 13685
Slow changes on domain
8 SS 10448 16126 16540 9056 12623 11854 10322 10648 11092 10838 9367 9123 9115 9493 9072 9405 9468 8463 8393 8457 10194 10877 10528 10369 10704 10340 11948 11281 10673 11007 12075
Slow changes on domain
9 CS 419 362 388 393 561 557 521 497 447 815 478 409 420 432 427 418 434 403 316 341 379 442 436 443 395 404 376 370 387 409 431
Allow unused Common Table Expressions
10 SS 269 225 210 225 321 278 268 320 313 434 273 263 275 277 309 294 283 226 205 213 254 271 273 258 258 259 278 393 257 227 249
Allow unused Common Table Expressions
11 CS 429 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 484 443 416 433 410 426
Cursor name can duplicate parameter and variable names in procedures and functions
12 SS 297 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 320 302 523 293 293 283
Cursor name can duplicate parameter and variable names in procedures and functions

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1869
http://tracker.firebirdsql.org/browse/core-2879
http://tracker.firebirdsql.org/browse/core-3095
http://tracker.firebirdsql.org/browse/core-3188
http://tracker.firebirdsql.org/browse/core-5210
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5674
https://github.com/FirebirdSQL/firebird/issues/7670

=== end of list ===