01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
[CURRENT] 05. STILL FAILS: tests which fail for at least TWO LAST runs (18 rows)
06. Has fails: tests with at least one fail for previous 30 runs (75 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (4 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (6 rows)
10. All tests: outcomes for previous 30 runs (2047 rows)
11. All tests: durations for previous 30 runs (4010 rows)
12. Skipped: tests which was intentionally excluded from execution (62 rows)

Generated 18.04.2024 13:55
Tested: HQ30.   Build: 3.0.12.33740;   SS: 18.04.24 12:49:51 - 18.04.24 13:16:01;   CS: 18.04.24 13:16:31 - 18.04.24 13:53:57;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.1; Firebird.Qa: 0.19.1

Tests which fail for at least two last runs:

Jump to LIST of unique test names from this report

NN Test name mode 3.0.12.33740
2024-04-18
3.0.12.33726
2024-04-06
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X X X X
Test TITLE
1 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Can't create table using long username and UTF8 as attachment charset
2 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Can't create table using long username and UTF8 as attachment charset
3 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
ISQL does not show encryption status of database
4 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
ISQL does not show encryption status of database
5 CS F F P P P P P P P P P P P P P P P P P P P P P P P X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS F F P P P P P P P P P F P P P P P P P P P P P P P X X X X X
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Unique constraint not working in encrypted database on first command
8 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Unique constraint not working in encrypted database on first command
9 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
10 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Error returned from DbCryptPlugin::setKey() is not shown
11 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
12 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
gstat may produce faulty report about presence of some none-encrypted pages in database
13 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Not user friendly output of gstat at encrypted database
14 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Not user friendly output of gstat at encrypted database
15 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
16 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
17 CS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Generator pages are not encrypted
18 SS F F F F F F F F F F F F F F F F F F F F F F F F F X X X X X
Generator pages are not encrypted

Elapsed time, milliseconds:

NN Test name mode median_ms 3.0.12.33740
2024-04-18
3.0.12.33726
2024-04-06
3.0.12.33725
2023-12-30
3.0.12.33722
2023-11-30
3.0.12.33712
2023-11-09
3.0.12.33706
2023-09-15
3.0.11.33689
2023-08-09
3.0.11.33687
2023-06-23
3.0.11.33685
2023-06-04
3.0.11.33683
2023-04-30
3.0.11.33673
2023-04-17
3.0.11.33666
2023-04-03
3.0.11.33664
2023-03-14
3.0.11.33657
2023-02-09
3.0.11.33648
2023-01-24
3.0.11.33646
2022-12-18
3.0.11.33639
2022-12-06
3.0.11.33636
2022-12-09
3.0.11.33631
2022-12-09
3.0.11.33622
2022-12-09
3.0.11.33621
2022-12-09
3.0.11.33620
2022-12-09
3.0.11.33618
2022-12-09
3.0.11.33616
2022-12-09
3.0.11.33612
2022-12-09
X X X X X
Test TITLE
1 CS 1040 1039 1025 1088 1041 1042 1046 1018 1058 1042 1048 1136 1051 1040 893 900 969 2023 1100 1085 1031 1016 1022 1017 999 1014 0 0 0 0 0
Can't create table using long username and UTF8 as attachment charset
2 SS 684 699 720 728 720 700 671 681 716 694 695 709 693 684 477 415 447 876 522 514 447 984 446 453 467 438 0 0 0 0 0
Can't create table using long username and UTF8 as attachment charset
3 CS 424 390 383 409 412 393 421 389 388 401 400 424 412 413 579 547 578 701 700 700 683 684 682 666 652 667 0 0 0 0 0
ISQL does not show encryption status of database
4 SS 202 184 190 187 190 201 187 185 187 202 200 191 192 188 295 234 253 299 299 300 299 299 299 299 283 300 0 0 0 0 0
ISQL does not show encryption status of database
5 CS 847 1419 1358 775 738 690 718 683 682 693 725 701 759 706 942 847 830 1016 1015 1038 969 931 963 968 931 952 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
6 SS 431 616 768 388 399 374 389 382 366 389 395 394 665 391 476 420 422 499 504 515 431 432 437 436 431 599 0 0 0 0 0
Unclear gstat's diagnostic when damaged page in DB file appears encrypted
7 CS 648 597 569 605 603 648 608 572 587 587 599 589 604 603 797 757 747 930 901 883 836 847 827 863 835 832 0 0 0 0 0
Unique constraint not working in encrypted database on first command
8 SS 350 322 318 317 322 315 327 547 318 320 329 350 324 315 444 363 362 436 426 432 345 362 367 368 353 363 0 0 0 0 0
Unique constraint not working in encrypted database on first command
9 CS 430 407 384 412 394 394 405 383 385 400 401 396 430 400 584 568 588 663 668 680 678 684 668 668 715 658 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
10 SS 196 187 186 190 190 187 187 184 187 196 194 194 194 194 310 240 253 299 299 313 279 315 299 298 297 282 0 0 0 0 0
Error returned from DbCryptPlugin::setKey() is not shown
11 CS 5821 5571 5577 5745 5610 5653 5515 5604 5562 5644 5821 5669 5648 5621 5861 5880 5968 6103 5921 6016 5941 6460 6208 6063 6144 6865 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
12 SS 5803 5668 5787 5994 5858 5859 5499 5857 5771 5844 5542 5803 5894 5776 5882 5789 5899 5841 5489 5623 6005 5764 5645 5941 5987 5578 0 0 0 0 0
gstat may produce faulty report about presence of some none-encrypted pages in database
13 CS 434 408 387 415 425 389 405 390 389 399 398 434 423 402 607 566 573 668 667 669 683 683 663 737 683 669 0 0 0 0 0
Not user friendly output of gstat at encrypted database
14 SS 253 192 189 195 191 188 187 189 186 197 197 193 349 195 290 261 253 299 298 298 300 299 298 315 314 300 0 0 0 0 0
Not user friendly output of gstat at encrypted database
15 CS 785 640 614 788 777 774 764 759 762 766 764 785 779 777 765 851 830 965 864 891 873 861 853 894 855 859 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
16 SS 518 392 513 390 386 577 375 609 384 392 389 393 392 385 599 419 518 631 559 552 583 563 577 585 635 541 0 0 0 0 0
Regression: FB3 throws "Datatypes are not comparable in expression" in procedure parameters
17 CS 639 580 568 605 588 582 577 602 587 639 582 588 609 579 767 815 747 874 900 868 831 801 831 814 831 827 0 0 0 0 0
Generator pages are not encrypted
18 SS 334 313 319 315 326 324 312 325 309 334 332 329 329 332 414 352 364 431 434 430 384 377 382 368 367 367 0 0 0 0 0
Generator pages are not encrypted

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-1292
http://tracker.firebirdsql.org/browse/core-5077
http://tracker.firebirdsql.org/browse/core-5501
http://tracker.firebirdsql.org/browse/core-5673
http://tracker.firebirdsql.org/browse/core-5793
http://tracker.firebirdsql.org/browse/core-5796
http://tracker.firebirdsql.org/browse/core-5831
http://tracker.firebirdsql.org/browse/core-6108
http://tracker.firebirdsql.org/browse/core-6163

=== end of list ===