01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (2 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (30 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2547 rows)
11. All tests: durations for previous 30 runs (4924 rows)
12. Skipped: tests which was intentionally excluded from execution (69 rows)

Generated 15.06.2024 04:50
Tested: FB60.   Build: 6.0.0.374;   SS: 15.06.24 03:06:29 - 15.06.24 03:52:01;   CS: 15.06.24 03:52:39 - 15.06.24 04:50:00;
OS and hardware info:  Windows 10 10.0.19045 ; logical CPUs: 8 ; total memory: 31.7 Gb 
QA-software: Python 3.11.2; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

Jump to LIST of unique test names from this report

NN Test name mode 6.0.0.374
2024-06-15
6.0.0.373
2024-06-13
6.0.0.372
2024-06-09
6.0.0.371
2024-06-08
6.0.0.368
2024-06-06
6.0.0.366
2024-05-31
6.0.0.363
2024-05-29
6.0.0.362
2024-05-25
6.0.0.359
2024-05-24
6.0.0.358
2024-05-23
6.0.0.357
2024-05-21
6.0.0.356
2024-05-18
6.0.0.355
2024-05-17
6.0.0.354
2024-05-16
6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-27
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.313
2024-04-15
Test TITLE
1 CS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Compress Data over the Network
2 SS P P P P P P P P P P P P P P F F P P P P P P P P P P P P P P
Compress Data over the Network
3 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
exclude_filter doesn't work for <services></section> section of the Trace facility
4 SS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
exclude_filter doesn't work for <services></section> section of the Trace facility
5 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
6 SS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS F F F F F F P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
8 SS F F F F F F P P P P P P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
9 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Very poor "similar to" performance
10 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
11 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
12 CS P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
13 SS P P P P P P P P P P P P P P P P P F P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
14 CS F P P P P P P P P P P P P P P P P P P P F P P P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
15 SS F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
16 SS P P P P P P P P P P P P P P F P P P P P P P P P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
17 CS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
18 SS F F F F F F F F F F F F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
19 CS P P P P P P P P P P P P P P P P F F X X X X X X X X X X X X
Make protocol schemes case-insensitive
20 SS P P P P P P P P P P P P P P P P F F X X X X X X X X X X X X
Make protocol schemes case-insensitive
21 CS P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X
Server crashes with IN (dbkey1, dbkey2, ...) condition
22 SS P P P P P P F X X X X X X X X X X X X X X X X X X X X X X X
Server crashes with IN (dbkey1, dbkey2, ...) condition
23 CS X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
24 SS X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
25 CS X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
26 SS X X X X X X X X X X X X X F X X X X X X X X X X X X X X X X
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
27 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
CREATE DOMAIN - create two domain with same name
28 SS P P P P P P P P P P P P P P P P P P P P P P P P P P F F F F
CREATE DOMAIN - create two domain with same name
29 CS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
30 SS P P P F P P P P P P P P P P P P P P P P P P P P P P P P P P
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]

Elapsed time, milliseconds:

NN Test name mode median_ms 6.0.0.374
2024-06-15
6.0.0.373
2024-06-13
6.0.0.372
2024-06-09
6.0.0.371
2024-06-08
6.0.0.368
2024-06-06
6.0.0.366
2024-05-31
6.0.0.363
2024-05-29
6.0.0.362
2024-05-25
6.0.0.359
2024-05-24
6.0.0.358
2024-05-23
6.0.0.357
2024-05-21
6.0.0.356
2024-05-18
6.0.0.355
2024-05-17
6.0.0.354
2024-05-16
6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-27
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.313
2024-04-15
Test TITLE
1 CS 24072 23092 23897 24686 24121 23816 24749 24360 24378 23723 24024 23842 23820 24275 24648 105606 25711 24532 25243 23367 24216 23701 23497 23669 24190 23970 23924 23392 24798 23993 24194
Compress Data over the Network
2 SS 23609 23109 23328 23131 23162 22936 24019 24804 23633 23045 23557 23577 24185 23176 33534 112289 107908 23147 23188 23700 22964 24616 23585 23856 24555 23899 23698 23277 24375 24125 23407
Compress Data over the Network
3 CS 2618 2636 3012 2615 3038 2605 2612 2846 2701 2593 2605 2625 2603 2617 2637 3649 2634 2665 2606 2672 2601 2599 2618 2763 2858 2821 2604 2596 2618 2595 2597
exclude_filter doesn't work for <services></section> section of the Trace facility
4 SS 2465 2510 2689 2447 2780 2438 2756 2551 2451 3008 2450 4801 2442 2435 2499 2502 2453 2980 2435 2441 2439 2468 2546 2448 2463 2550 2450 2443 2468 2430 2981
exclude_filter doesn't work for <services></section> section of the Trace facility
5 CS 2279 2274 2290 2271 2402 2278 2273 2286 2282 2365 2536 2293 2303 2276 2289 2539 2739 2275 2279 2275 2278 2272 2275 2278 2298 2287 2277 2273 2287 2280 2267
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
6 SS 2146 2245 2144 2145 2155 2264 2140 2143 2148 2162 2147 2157 2210 2141 2145 2158 2175 2162 2142 2144 2142 2144 2164 2145 2143 2169 2143 2144 2168 2144 2148
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 CS 833 1156 1137 1135 837 1137 1214 752 853 934 852 911 918 793 890 856 804 790 775 758 759 763 761 761 862 829 749 767 872 774 789
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
8 SS 524 827 876 834 524 950 922 521 511 524 515 526 537 530 524 939 557 512 509 512 516 513 521 515 519 553 539 540 508 561 497
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
9 SS 309 296 309 301 294 298 305 307 309 299 305 294 298 311 315 2153 328 296 309 310 315 298 312 297 295 312 316 311 315 332 317
Very poor "similar to" performance
10 SS 299 280 310 297 301 301 297 289 300 294 302 300 294 300 299 940 334 312 300 294 297 295 299 296 295 296 319 294 354 289 313
SIMILAR TO does not return result when invalid pattern is used (with two adjacent special characters that should be escaped but aren't)
11 CS 3479 3343 3407 3489 3288 3444 3875 3858 3462 3465 3997 3389 3493 3582 3610 4454 3365 3486 3527 3381 3471 3863 3377 3473 3690 3410 3648 3419 3395 3502 3762
Error "connection lost to database" could happen when application creates few local attachments (using XNET) simultaneously
12 CS 685 547 566 553 546 565 562 616 564 567 579 608 564 559 631 823 740 578 3069 2860 2640 2884 2875 2880 2881 2877 2894 2880 3288 2860 2853
Efficient table scans for DBKEY-based range conditions
13 SS 381 342 362 346 355 365 347 358 363 363 364 345 360 363 368 626 394 346 2806 2461 2442 2438 3029 2445 2464 2456 2444 2452 2441 2458 2455
Efficient table scans for DBKEY-based range conditions
14 CS 21570 21514 21551 21602 21553 21548 21551 21563 21563 21575 21538 21549 21570 21573 21793 21837 21769 21575 21570 21676 21578 21897 21602 21555 21560 21559 21749 21596 21593 21561 21563
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
15 SS 21356 22328 21357 21350 21376 21345 21348 21349 21341 21321 21359 21342 21337 21376 21859 21409 21389 21346 21396 21363 21352 21373 21356 21369 21357 21355 21323 21362 21367 21354 21348
When the statement timeout is set, it causes the lock manager to delay reporting deadlocks until timeout is expired
16 SS 2780 2733 2858 2758 3033 2780 2858 2955 2781 2760 2796 2733 2766 3163 3300 4068 2789 2765 2768 2782 3018 2752 2732 2775 2773 2752 2771 2785 2861 2780 2835
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
17 CS 1447 1047 1078 1145 1053 1072 1083 1531 1430 1494 1444 1419 1435 1476 1518 6137 1936 1497 1077 1480 1502 1103 1460 1474 1437 1440 1464 1476 1450 1513 1166
The partial index is not involved when filtering conditions through OR.
18 SS 920 577 603 600 623 590 818 1094 1191 981 1059 918 919 944 1157 1458 762 919 666 1152 1221 944 916 918 1143 920 925 927 916 1164 921
The partial index is not involved when filtering conditions through OR.
19 CS 1659 1577 1644 1646 1671 1658 1600 1669 1622 1660 1693 1640 1620 1675 1658 5006 1665 2349 2376 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
20 SS 1022 968 1013 1034 1058 1002 1011 1002 1025 1014 1034 1019 1010 1103 1049 1059 1008 1448 1462 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
21 CS 468 452 468 493 506 462 461 554 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server crashes with IN (dbkey1, dbkey2, ...) condition
22 SS 316 296 299 587 316 298 372 403 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Server crashes with IN (dbkey1, dbkey2, ...) condition
23 CS 2626 0 0 0 0 0 0 0 0 0 0 0 0 0 2626 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
24 SS 2450 0 0 0 0 0 0 0 0 0 0 0 0 0 2450 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
25 CS 2619 0 0 0 0 0 0 0 0 0 0 0 0 0 2619 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
26 SS 2460 0 0 0 0 0 0 0 0 0 0 0 0 0 2460 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Trace INCLUDE_FILTER with [[:WHITESPACE:]]+ does not work when statement contains newline is issued
27 CS 721 671 745 741 684 733 708 711 688 675 693 680 731 743 728 1341 741 742 690 735 692 727 724 689 690 691 685 745 769 739 718
CREATE DOMAIN - create two domain with same name
28 SS 453 421 442 459 448 444 752 446 463 449 442 436 438 450 434 467 452 507 436 454 455 457 459 495 457 436 487 451 466 474 459
CREATE DOMAIN - create two domain with same name
29 CS 3398 3350 3377 3773 3402 3386 3375 3393 3380 3382 3797 3369 3444 3547 3369 3714 3513 3384 3454 3537 3694 3366 3451 3370 3409 3534 3418 3371 3395 3531 3342
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
30 SS 2882 2864 3237 3247 2806 2797 2780 2889 2802 2825 2902 2795 3119 3376 3249 2836 2981 2795 3067 3131 2818 2827 3152 2796 3296 3139 3306 2789 2875 3133 2818
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-3168
http://tracker.firebirdsql.org/browse/core-3658
http://tracker.firebirdsql.org/browse/core-5236
http://tracker.firebirdsql.org/browse/core-5854
http://tracker.firebirdsql.org/browse/core-5931
http://tracker.firebirdsql.org/browse/core-6142
http://tracker.firebirdsql.org/browse/core-6278
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/bugs/test_trace_eol_cr_space_nl.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_41.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_role_in_service_attachment.py
https://github.com/FirebirdSQL/firebird/issues/6802
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7804
https://github.com/FirebirdSQL/firebird/issues/8066
https://github.com/FirebirdSQL/firebird/issues/8136

=== end of list ===