01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (3 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (2 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (5 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (45 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
11. All tests: outcomes for previous 30 runs (2633 rows)
12. Skipped: tests which was intentionally excluded from execution (72 rows)

Generated UTC 18.01.2025 02:20
Tested: FB60.   Build / date: 6.0.0.585-2d6bb146 / 2025.01.16;
Test machine: Windows 10 10.0.19045; logical CPUs: 8; RAM: 31 Gb 
QA software: Python: 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.6; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
6.0.0.585
2025.01.16
6.0.0.584
2025.01.15
6.0.0.581
2025.01.15
6.0.0.581
2025.01.14
6.0.0.577
2025.01.14
6.0.0.577
2025.01.13
6.0.0.576
2025.01.12
6.0.0.573
2025.01.10
6.0.0.571
2024.12.31
6.0.0.570
2024.12.30
6.0.0.565
2024.12.28
6.0.0.564
2024.12.26
6.0.0.560
2024.12.25
6.0.0.559
2024.12.23
6.0.0.556
2024.12.22
6.0.0.555
2024.12.19
6.0.0.553
2024.12.17
6.0.0.552
2024.12.11
6.0.0.550
2024.12.10
6.0.0.548
2024.12.08
6.0.0.544
2024.12.05
6.0.0.543
2024.12.03
6.0.0.540
2024.12.02
6.0.0.539
2024.11.28
6.0.0.535
2024.11.27
6.0.0.535
2024.11.26
6.0.0.534
2024.11.25
6.0.0.533
2024.11.17
6.0.0.532
2024.11.17
6.0.0.532
2024.11.16
Test TITLE
1 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Cannot alter generator's comment to the same value
2 SS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Cannot alter generator's comment to the same value
3 CS P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Only one client can access a readonly database
4 CS P P P P P P F F P P P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
5 SS P P P P P P F F P P P P P P P P P P P P P P P P P P P P P P
Improve sorting performance when long VARCHARs are involved
6 CS P P P P P P F F F F P P P P P P P P P P P P P P P P P P P P
Add database owner to mon$database
7 SS P P P P P P F F F F P P P P P P P P P P P P P P P P P P P P
Add database owner to mon$database
8 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Regression: ISQL does not destroy the SQL statement
9 SS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Regression: ISQL does not destroy the SQL statement
10 CS P P P P P F F F F F P P P P P P P P P P P P P P P P P P P P
Make user names behave according to SQL identifiers rules
11 SS P P P P P F F F F F P P P P P P P P P P P P P P P P P P P P
Make user names behave according to SQL identifiers rules
12 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Regression: ORDER BY clause on compound index may disable usage of other indices
13 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Regression: ORDER BY clause on compound index may disable usage of other indices
14 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Regression: could not execute query (select from view with nested view)
15 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Regression: could not execute query (select from view with nested view)
16 CS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
Can't create the shadow file
17 SS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
Can't create the shadow file
18 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Wire compression causes freezes
19 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
System table with keywords
20 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P P
System table with keywords
21 CS P P P F F F F F F F P P P P P P P P P P P P P P P P P P P P
Connection to server may hang when working with encrypted databases over non-TCP protocol
22 SS P P P F F F F F F F P P P P P P P P P P P P P P P P P P P P
Connection to server may hang when working with encrypted databases over non-TCP protocol
23 CS F P P P P P P P P P P P P P P P P P P P P P P P P F P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
24 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
25 CS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Wrong detection of must-be-delimited user names
26 SS P P P P P P P P P F P P P P P P P P P P P P P P P P P P P P
Wrong detection of must-be-delimited user names
27 CS P P P P P P P P P P P P P P P P P P F F P P P P P P P P P F
EXPLAIN statement and RDB$SQL package
28 SS P P P P P P P P P P P P P P P P P P F F P P P P P P P P P F
EXPLAIN statement and RDB$SQL package
29 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
30 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
31 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
FB5 uses PK for ordered plan even if less count of fields matching index exists
32 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
FB5 uses PK for ordered plan even if less count of fields matching index exists
33 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
ORDER BY ASC using index (single) and WHERE clause
34 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
ORDER BY ASC using index (single) and WHERE clause
35 CS P P P P P P F F F F P P P P P P P P P P P P P P P P P P P P
Create database: non sysdba user
36 SS P P P P P P F F F F P P P P P P P P P P P P P P P P P P P P
Create database: non sysdba user
37 CS P P P P P P P P P P P P P P P P P P P F P P P P P P P P P F
External Connections Pool, functionality test 01
38 CS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
CREATE SHADOW: check basic usage
39 SS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
CREATE SHADOW: check basic usage
40 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
41 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
42 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
43 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
44 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
45 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F F
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.

Elapsed time, milliseconds:

NN Test name mode median_ms
6.0.0.585
2025.01.16
6.0.0.584
2025.01.15
6.0.0.581
2025.01.15
6.0.0.581
2025.01.14
6.0.0.577
2025.01.14
6.0.0.577
2025.01.13
6.0.0.576
2025.01.12
6.0.0.573
2025.01.10
6.0.0.571
2024.12.31
6.0.0.570
2024.12.30
6.0.0.565
2024.12.28
6.0.0.564
2024.12.26
6.0.0.560
2024.12.25
6.0.0.559
2024.12.23
6.0.0.556
2024.12.22
6.0.0.555
2024.12.19
6.0.0.553
2024.12.17
6.0.0.552
2024.12.11
6.0.0.550
2024.12.10
6.0.0.548
2024.12.08
6.0.0.544
2024.12.05
6.0.0.543
2024.12.03
6.0.0.540
2024.12.02
6.0.0.539
2024.11.28
6.0.0.535
2024.11.27
6.0.0.535
2024.11.26
6.0.0.534
2024.11.25
6.0.0.533
2024.11.17
6.0.0.532
2024.11.17
6.0.0.532
2024.11.16
Test TITLE
1 CS 786 734 817 804 756 797 786 783 761 756 1123 797 774 795 786 778 887 778 787 788 785 783 781 1153 786 837 804 782 823 782 783
Cannot alter generator's comment to the same value
2 SS 546 531 902 513 556 549 520 534 530 528 855 553 564 533 534 760 567 633 546 539 664 529 531 551 532 547 532 549 701 527 552
Cannot alter generator's comment to the same value
3 CS 1544 1500 1533 1713 1547 1548 1560 1618 1543 2870 1540 1567 1545 1527 1518 1533 1635 1515 1548 1542 1548 1543 1576 1581 1528 1531 1559 1555 1524 1544 1515
Only one client can access a readonly database
4 CS 738 703 757 786 802 737 731 1131 1097 746 733 821 729 783 769 732 739 726 727 736 757 841 728 726 738 763 767 729 760 725 728
Improve sorting performance when long VARCHARs are involved
5 SS 467 469 493 453 459 453 468 851 851 461 475 456 458 466 457 472 459 451 455 458 502 474 474 484 454 472 454 458 474 472 474
Improve sorting performance when long VARCHARs are involved
6 CS 1290 1250 1371 1402 1277 1350 1278 1373 1421 1239 1226 1328 1286 1358 1272 1296 1292 1274 1292 1314 1301 1292 1288 1285 1288 1284 1282 1289 1292 1282 1361
Add database owner to mon$database
7 SS 808 765 891 793 798 784 810 849 847 1043 729 808 854 797 801 803 821 793 795 954 788 830 882 830 801 808 809 830 811 814 791
Add database owner to mon$database
8 CS 559 547 604 596 558 560 551 558 593 558 557 600 552 562 559 564 553 565 559 566 606 562 572 558 558 565 581 596 556 557 548
Regression: ISQL does not destroy the SQL statement
9 SS 376 359 379 382 378 406 369 371 373 372 421 372 373 377 381 376 376 378 363 459 414 374 409 374 373 380 401 376 372 378 374
Regression: ISQL does not destroy the SQL statement
10 CS 2380 2297 2485 2344 2343 2384 2727 2381 2419 2380 2422 2371 2399 2383 2439 2364 2530 2368 2356 2357 2521 2346 2340 2386 2359 2427 2350 2334 3613 2409 2329
Make user names behave according to SQL identifiers rules
11 SS 1426 1484 1706 1758 1713 1368 1963 1648 1793 1531 1540 1364 1728 1366 1348 1378 1346 1333 1352 1515 1601 1363 1461 1590 1356 1391 2327 1351 1379 1331 1370
Make user names behave according to SQL identifiers rules
12 CS 680 656 680 682 646 694 679 696 650 687 659 682 685 654 701 727 690 658 704 807 651 661 649 686 659 655 662 683 681 652 917
Regression: ORDER BY clause on compound index may disable usage of other indices
13 SS 441 453 619 440 444 438 437 435 460 465 476 436 443 436 437 466 461 425 429 470 473 440 579 440 437 428 455 442 440 427 728
Regression: ORDER BY clause on compound index may disable usage of other indices
14 CS 754 719 767 787 781 751 739 745 769 745 742 748 779 772 741 738 770 734 734 779 749 756 745 783 754 770 769 752 767 755 1011
Regression: could not execute query (select from view with nested view)
15 SS 523 563 522 516 507 523 519 552 569 520 564 533 525 526 558 518 521 511 523 551 519 517 531 518 814 520 531 522 508 539 793
Regression: could not execute query (select from view with nested view)
16 CS 1441 1375 1415 1515 1423 1416 1414 1424 1480 1403 1413 1019 1437 1473 1453 1538 1510 1438 1454 1636 1456 1428 1418 1429 1481 1490 1456 1454 1484 1409 1445
Can't create the shadow file
17 SS 984 1015 1008 979 981 984 1084 1030 1034 1049 1020 797 969 958 971 971 984 967 943 1068 1046 981 977 1003 1196 982 985 988 978 991 977
Can't create the shadow file
18 SS 30208 30375 31113 30214 31314 29953 30015 30478 30118 30541 30041 30219 30110 29970 30033 30519 30142 30513 29943 30298 30762 30483 31178 29868 30024 30046 29837 30223 30203 30691 29662
Wire compression causes freezes
19 CS 579 578 622 661 554 565 573 601 596 573 567 566 590 561 599 566 567 567 560 590 588 581 598 578 600 562 617 927 566 596 599
System table with keywords
20 SS 386 359 403 385 401 397 388 401 400 393 394 375 383 383 380 374 380 401 376 381 380 387 415 382 386 391 379 784 409 381 409
System table with keywords
21 CS 1931 1929 1968 1931 2327 2274 1954 2278 1957 1926 1981 1925 2011 1911 1928 1903 1917 1922 1921 1939 2111 1920 1966 1915 1919 1932 1917 1956 1915 1950 1934
Connection to server may hang when working with encrypted databases over non-TCP protocol
22 SS 1613 1577 1642 1609 2885 1925 1751 1879 1762 1621 1629 1626 1604 1606 1602 1607 1600 1595 1631 1604 1611 1632 1617 1593 1605 1611 1612 1618 1633 1615 1596
Connection to server may hang when working with encrypted databases over non-TCP protocol
23 CS 21627 21906 21651 21663 21609 21642 21623 21619 21765 21622 21611 21624 21624 21617 21633 21614 21628 21655 21613 21646 21665 21618 21664 21634 21951 21620 21972 21626 21609 21627 21627
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
24 SS 21425 22375 21415 21435 21426 21446 21431 21443 21459 21443 21416 21431 21413 21423 21444 21392 21396 21426 21415 21421 21652 21421 21419 21403 21414 21415 21451 21434 21437 21424 21412
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
25 CS 13044 10563 13491 13002 12859 12882 12942 13146 13631 14047 603 12925 13057 12873 12865 12961 12887 13231 13125 13811 13868 13102 13579 12926 13478 13034 12932 13539 14944 12902 13054
Wrong detection of must-be-delimited user names
26 SS 9100 8126 9178 9177 9346 9269 8946 9192 9083 9147 413 9217 8974 9217 9065 9008 9117 8966 9230 9143 8968 9052 9272 9143 9226 9164 9025 8903 9036 9012 8848
Wrong detection of must-be-delimited user names
27 CS 784 750 828 789 775 777 815 782 857 840 772 785 812 807 773 775 779 785 781 1149 1792 779 830 779 784 779 822 785 784 782 803
EXPLAIN statement and RDB$SQL package
28 SS 544 515 577 528 570 548 546 534 537 533 535 543 548 531 586 537 550 532 534 902 1285 549 533 566 550 555 551 519 530 538 565
EXPLAIN statement and RDB$SQL package
29 CS 1505 1141 1514 1544 1146 1180 1139 1147 1195 1149 1150 1158 1538 1553 1534 1521 1541 1648 1501 1179 1208 1726 1510 1558 1536 1526 1179 1180 1516 1516 1163
The partial index is not involved when filtering conditions through OR.
30 SS 997 657 1371 983 1151 656 1001 892 902 663 676 659 1252 999 1093 1237 1256 993 1000 672 902 1279 1287 1009 1009 1272 1006 680 995 993 662
The partial index is not involved when filtering conditions through OR.
31 CS 1556 1500 1554 1545 1525 1531 1558 1993 1572 1552 1523 1564 1541 2139 1513 1745 1566 1531 1785 1548 1558 1564 1526 1641 1547 1760 1589 1672 1642 1514 1538
FB5 uses PK for ordered plan even if less count of fields matching index exists
32 SS 1296 1265 1334 1281 1853 1308 1277 1296 1298 1372 1480 1307 1281 1271 1322 1331 1285 1299 1463 1282 1282 1441 1278 1296 1303 1295 1273 1296 1297 1291 1300
FB5 uses PK for ordered plan even if less count of fields matching index exists
33 CS 656 625 704 651 677 652 699 728 646 653 672 660 674 685 645 665 649 646 651 690 650 655 647 655 686 652 676 658 679 648 807
ORDER BY ASC using index (single) and WHERE clause
34 SS 431 422 444 443 439 425 428 442 448 426 439 422 444 448 433 429 438 424 428 425 441 423 418 443 425 426 425 419 433 442 527
ORDER BY ASC using index (single) and WHERE clause
35 CS 828 1203 1210 1211 1212 1234 1213 659 629 651 659 849 833 812 847 807 812 829 832 866 831 814 828 813 861 807 822 824 852 819 808
Create database: non sysdba user
36 SS 551 750 776 794 812 756 767 417 419 429 413 552 538 546 550 549 559 563 538 567 579 551 549 564 554 545 551 542 553 547 549
Create database: non sysdba user
37 CS 28864 28720 28809 28887 28932 28917 28810 28843 28808 29015 28804 28849 28812 28983 28802 28818 28852 28872 28865 30445 29476 29110 28866 28863 28857 29445 28817 28905 28845 28873 29758
External Connections Pool, functionality test 01
38 CS 574 547 569 566 576 637 573 565 591 589 561 593 557 599 593 566 566 568 605 629 587 610 561 562 569 625 590 598 559 596 558
CREATE SHADOW: check basic usage
39 SS 387 359 387 397 400 375 385 387 457 374 379 426 409 410 397 374 406 399 386 370 409 370 387 388 386 375 379 392 393 374 374
CREATE SHADOW: check basic usage
40 CS 6205 8028 6241 7785 6330 6256 6184 6205 6212 6219 6261 6205 6160 6271 6196 6146 6188 6241 6152 6210 6159 7208 6223 6157 6217 6181 6145 6148 6166 3316 3304
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
41 SS 5845 5753 5854 5868 5871 5829 5895 5882 5845 5838 5838 5846 6375 5837 5846 5843 5951 5831 5823 5857 5855 5860 5859 5846 5893 5826 5839 5844 5838 3028 3053
READ CONSISTENCY. Changes produced by DELETE statement must be UNDONE when cursor resultset becomes empty after this statement start. Test-02
42 CS 6184 6074 6144 6222 6140 6438 6139 6231 6183 6622 6197 6168 6159 6227 6144 6204 6160 6166 6156 6282 6186 6228 6206 6219 6136 7240 6188 6330 6134 3287 3308
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
43 SS 5852 5782 5852 5895 5881 5880 5842 6082 5859 5863 5956 5840 5853 5854 5850 5840 5892 5837 5845 5850 6107 5839 5854 6102 5839 5837 5851 5865 6201 3039 3055
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by MERGE. Test-01.
44 CS 8223 8200 8268 8319 8281 7904 7302 8216 8288 8231 8251 8730 8317 8278 8281 8302 8457 8336 8232 7235 8570 7268 7325 7270 7214 7596 7231 7234 6270 3816 3344
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.
45 SS 6676 6100 6934 5936 6991 5935 6931 6715 6922 6676 6676 5916 6942 5898 5912 6994 6925 6658 6685 6654 5931 6978 5957 6681 6696 6932 6688 6673 6193 3064 3069
READ CONSISTENCY. Check creation of new statement-level snapshot and restarting changed caused by UPDATE. Test-03.

List of tests in this report:


http://tracker.firebirdsql.org/browse/CORE-1142
http://tracker.firebirdsql.org/browse/CORE-2018
http://tracker.firebirdsql.org/browse/CORE-2650
http://tracker.firebirdsql.org/browse/CORE-4218
http://tracker.firebirdsql.org/browse/CORE-4321
http://tracker.firebirdsql.org/browse/CORE-4811
http://tracker.firebirdsql.org/browse/CORE-5020
http://tracker.firebirdsql.org/browse/CORE-5381
http://tracker.firebirdsql.org/browse/CORE-5630
http://tracker.firebirdsql.org/browse/CORE-6348
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/arno/optimizer/test_opt_sort_by_index_18.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/database/create/test_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/shadow/test_create_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_statement_delete_undone_02.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_restart_on_merge_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_restart_on_update_03.py
https://github.com/FirebirdSQL/firebird/issues/310
https://github.com/FirebirdSQL/firebird/issues/5995
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/7106
https://github.com/FirebirdSQL/firebird/issues/7675
https://github.com/FirebirdSQL/firebird/issues/7804
https://github.com/FirebirdSQL/firebird/issues/7921
=== end of list ===

Last commits information (all timestamps in UTC):