01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (20 rows)
06. Has fails: tests with at least one fail for previous 30 runs (77 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (2054 rows)
11. All tests: durations for previous 30 runs (4022 rows)
12. Skipped: tests which was intentionally excluded from execution (63 rows)

Generated 14.06.2024 14:04
Tested: HQ30.   Build: 3.0.12.33746;   SS: 14.06.24 12:58:38 - 14.06.24 13:25:17;   CS: 14.06.24 13:25:51 - 14.06.24 14:03:42;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 3.0.12.33746
2024-06-14
3.0.12.33745
2024-06-10
3.0.12.33744
2024-05-10
3.0.12.33740
2024-04-21
3.0.12.33726
2024-04-06
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Can't create table using long username and UTF8 as attachment charset
2 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Can't create table using long username and UTF8 as attachment charset
3 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
ISQL does not show encryption status of database
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
ISQL does not show encryption status of database
5 CS F F F F F P P P P P P P P P P P P P P P P P P P P P P P X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F F F F P P P P P P P P P F P P P P P P P P P P P P P X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS F F F F P F P P P P P F F P F F X X X X X X X X X X X X X X
Slow changes on domain
8 SS F F F F P P P P P P P P P P P P X X X X X X X X X X X X X X
Slow changes on domain
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Unique constraint not working in encrypted database on first command
10 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Unique constraint not working in encrypted database on first command
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Error returned from DbCryptPlugin::setKey() is not shown
12 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Error returned from DbCryptPlugin::setKey() is not shown
13 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
gstat may produce faulty report about presence of some none-encrypted pages in database
14 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
gstat may produce faulty report about presence of some none-encrypted pages in database
15 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Not user friendly output of gstat at encrypted database
16 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Not user friendly output of gstat at encrypted database
17 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
18 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
19 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Generator pages are not encrypted
20 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F X X
Generator pages are not encrypted

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33746
2024-06-14
3.0.12.33745
2024-06-10
3.0.12.33744
2024-05-10
3.0.12.33740
2024-04-21
3.0.12.33726
2024-04-06
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X
Test TITLE
1 CS 1040 1055 1036 1099 1034 1025 1088 1041 1042 1046 1018 1058 1042 1048 1136 1051 1040 893 900 969 2023 1100 1085 1031 1016 1022 1017 999 1014 0 0
Can't create table using long username and UTF8 as attachment charset
2 SS 693 708 698 710 695 720 728 720 700 671 681 716 694 695 709 693 684 477 415 447 876 522 514 447 984 446 453 467 438 0 0
Can't create table using long username and UTF8 as attachment charset
3 CS 417 390 386 380 385 383 409 412 393 421 389 388 401 400 424 412 413 579 547 578 701 700 700 683 684 682 666 652 667 0 0
ISQL does not show encryption status of database
4 SS 201 200 201 185 190 190 187 190 201 187 185 187 202 200 191 192 188 295 234 253 299 299 300 299 299 299 299 283 300 0 0
ISQL does not show encryption status of database
5 CS 931 1378 1367 1389 1370 1358 775 738 690 718 683 682 693 725 701 759 706 942 847 830 1016 1015 1038 969 931 963 968 931 952 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 431 830 806 774 614 768 388 399 374 389 382 366 389 395 394 665 391 476 420 422 499 504 515 431 432 437 436 431 599 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS 7738 13281 13226 13861 12988 7733 7895 7654 7634 7608 7617 7656 7718 8114 7659 7743 7849 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
8 SS 7042 11624 11684 12136 11349 7047 6715 6638 7038 6561 7145 6580 7113 6738 6861 7091 6687 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Slow changes on domain
9 CS 621 635 557 590 589 569 605 603 648 608 572 587 587 599 589 604 603 797 757 747 930 901 883 836 847 827 863 835 832 0 0
Unique constraint not working in encrypted database on first command
10 SS 339 334 334 308 317 318 317 322 315 327 547 318 320 329 350 324 315 444 363 362 436 426 432 345 362 367 368 353 363 0 0
Unique constraint not working in encrypted database on first command
11 CS 408 385 382 387 384 384 412 394 394 405 383 385 400 401 396 430 400 584 568 588 663 668 680 678 684 668 668 715 658 0 0
Error returned from DbCryptPlugin::setKey() is not shown
12 SS 199 216 200 186 198 186 190 190 187 187 184 187 196 194 194 194 194 310 240 253 299 299 313 279 315 299 298 297 282 0 0
Error returned from DbCryptPlugin::setKey() is not shown
13 CS 5722 5563 5539 5700 5533 5577 5745 5610 5653 5515 5604 5562 5644 5821 5669 5648 5621 5861 5880 5968 6103 5921 6016 5941 6460 6208 6063 6144 6865 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
14 SS 5832 5874 5783 6072 5824 5787 5994 5858 5859 5499 5857 5771 5844 5542 5803 5894 5776 5882 5789 5899 5841 5489 5623 6005 5764 5645 5941 5987 5578 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
15 CS 424 389 379 389 403 387 415 425 389 405 390 389 399 398 434 423 402 607 566 573 668 667 669 683 683 663 737 683 669 0 0
Not user friendly output of gstat at encrypted database
16 SS 213 200 226 195 187 189 195 191 188 187 189 186 197 197 193 349 195 290 261 253 299 298 298 300 299 298 315 314 300 0 0
Not user friendly output of gstat at encrypted database
17 CS 778 617 667 603 610 614 788 777 774 764 759 762 766 764 785 779 777 765 851 830 965 864 891 873 861 853 894 855 859 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
18 SS 522 527 517 526 391 513 390 386 577 375 609 384 392 389 393 392 385 599 419 518 631 559 552 583 563 577 585 635 541 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
19 CS 607 578 592 577 584 568 605 588 582 577 602 587 639 582 588 609 579 767 815 747 874 900 868 831 801 831 814 831 827 0 0
Generator pages are not encrypted
20 SS 333 337 317 315 319 319 315 326 324 312 325 309 334 332 329 329 332 414 352 364 431 434 430 384 377 382 368 367 367 0 0
Generator pages are not encrypted

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5673
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5796
http://tracker.firebirdsql.org/browse/core-5831
http://tracker.firebirdsql.org/browse/core-6108
http://tracker.firebirdsql.org/browse/core-6163

=== end of list ===