01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (4 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (42 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (1 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (0 rows)
10. All tests: outcomes for previous 30 runs (4988 rows)
11. All tests: durations for previous 30 runs (5004 rows)
12. Skipped: tests which was intentionally excluded from execution (144 rows)

Generated 10.06.2024 17:41
Tested: FB60.   Build: 6.0.0.373;   SS: 10.06.24 15:31:58 - 10.06.24 16:28:37;   CS: 10.06.24 16:29:22 - 10.06.24 17:40:07;
OS and hardware info:  Linux 6.5.0-5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.5.13-1 (2023-11-29) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.11.9, virtual env; pytest: 7.4.4; firebird.driver: 1.10.4; Firebird.Qa: 0.19.3

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 6.0.0.373
2024-06-10
6.0.0.371
2024-06-08
6.0.0.368
2024-06-07
6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-26
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.314
2024-04-15
6.0.0.313
2024-04-14
6.0.0.312
2024-04-10
6.0.0.310
2024-04-04
6.0.0.308
2024-04-03
6.0.0.305
2024-04-02
6.0.0.303
2024-04-01
6.0.0.301
2024-03-29
6.0.0.299
2024-03-24
6.0.0.295
2024-03-22
6.0.0.294
2024-03-21
6.0.0.293
2024-03-17
Test TITLE
1 SS P P P X P P P P P P X P P P P P P P F P P P P P P P P P P P
Compress Data over the Network
2 CS P P P P P P P P P P X F P P P P P P P P P P P P P P P P P P
Wrong results or unexpected errors while sorting a large data set
3 CS P P F P P P P P P P X P P P P P P P P P P P P P P P P P P P
exclude_filter doesn't work for <services></section> section of the Trace facility
4 SS P P F X P P P P P P X P P P P P P P P P P P P P P P P P P P
exclude_filter doesn't work for <services></section> section of the Trace facility
5 CS P P P P P P P P P P X P P P P P P P P P P F P P P P P P P P
Ability to cancel waiting in lock manager
6 CS P P F P P P P P P P X P P P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 SS P P F X P P P P P P X P P P P P P P P P P P P P P P P P P P
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
8 CS P P P F P P P P P F X P P P P P P P P P P P P P P P P P P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
9 CS P P P F P P P P P P X P P P P P P P P P P P P P P P P P P P
Allow output to trace explain plan form.
10 CS P P P P P P P P P P X P P P P P P P F P P P P P P P P P P P
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
11 CS F F F P P P P P P P X P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
12 SS F F F X P P P P P P X P P P P P P P P P P P P P P P P P P P
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
13 CS P P P P P P P P P P X P P P P P P P P P P P P P P P P F F F
Slow changes on domain
14 SS P P P X P P P P P P X P P P P P P P P P P P P P P P P F F F
Slow changes on domain
15 CS P P P P P P P P P P X P P P P P P P P P P P P P F F F F F F
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
16 SS P P P X P P P P P P X P P P P P P P P P P P P P F F F F F F
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
17 CS P P P P F P P P P P X P P P P P P P P P P P P P P P P P P P
Provide information about Global Commit Number, Commit Number of currently used database snapshot (if any) and Commit Numbers assigned to the committed transactions
18 CS P P P P F P P P P P X P P P P P P P P P P P P P P P P P P P
Trace could not work correctly with quoted file names in trace configurations
19 CS P P P P P P F P P P X P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
20 SS P P P X P P F P P P X P P P P P P P P P P P P P P P P P P P
Efficient table scans for DBKEY-based range conditions
21 CS P P P P P P P P P P X P P P P P P P P F P X X X X X X X X X
Implement SQL standard FORMAT clause for CAST between string types and datetime types [CORE6507]
22 SS P P P X P P P P P P X P P P P P P P P F P X X X X X X X X X
Implement SQL standard FORMAT clause for CAST between string types and datetime types [CORE6507]
23 CS P P P F P P P P P P X P P P P P P P P P P P P P P P P P P P
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
24 SS P P P X P P P P P P X P P P P P P F P P P P P P P P P P P P
Indexed STARTING WITH execution is very slow with UNICODE collation
25 CS P P P P P P P P P P X P P P P P P P P P P F F F F F F F F F
PSQL and SQL profiler
26 SS P P P X P P P P P P X P P P P P P P P P P F F F F F F F F F
PSQL and SQL profiler
27 CS P P P F P P P P P P X P P P P P P P P P P P P P P F P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
28 SS P P P X P P P P E E X P P P P P P P P P F P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
29 CS F F F F F F F F F F X F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
30 SS F F F X F F F F F F X F F F F F F F F F F F F F F F F F F F
The partial index is not involved when filtering conditions through OR.
31 CS P P P P P F F X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
32 SS P P P X P F F X X X X X X X X X X X X X X X X X X X X X X X
Make protocol schemes case-insensitive
33 CS P P P P P P P P P P X P P P P P P P P P P P P P F F F F F F
Basic test of RDB$BLOB_UTIL package functionality
34 SS P P P X P P P P P P X P P P P P P P P P P P P P F F F F F F
Basic test of RDB$BLOB_UTIL package functionality
35 CS P P P P P P P P P P X P P P P F F F F P P P P P P P P P P P
CREATE DOMAIN - create two domain with same name
36 SS P P P X P P P P P P X P P P P F F F F P P P P P P P P P P P
CREATE DOMAIN - create two domain with same name
37 CS P P P P P P P P P P X P P P P P P P P P P P P P P P F F F F
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
38 SS P P P X P P P P P P X P P P P P P P P P P P P P P P F F F F
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
39 CS P P F P P P P P P P X P P P P P P P P P P P P P P P P P P P
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
40 SS P P F X P P P P P P X P P P P P P P P P P P P P P P P P P P
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
41 CS P P P P P P P P P P X P P P P P P P F P P P P P P P P P P P
Check ability to make connect to FB services and add/drop user
42 CS P P P F P P P P P P X P P P P P P P P P P P P P P P P P P P
External Connections Pool, functionality test 01

Elapsed time, milliseconds:

NN Test name mode median_ms 6.0.0.373
2024-06-10
6.0.0.371
2024-06-08
6.0.0.368
2024-06-07
6.0.0.351
2024-05-15
6.0.0.348
2024-05-14
6.0.0.346
2024-05-08
6.0.0.345
2024-05-07
6.0.0.344
2024-05-03
6.0.0.342
2024-04-30
6.0.0.339
2024-04-29
6.0.0.336
2024-04-26
6.0.0.333
2024-04-24
6.0.0.328
2024-04-23
6.0.0.327
2024-04-21
6.0.0.325
2024-04-19
6.0.0.324
2024-04-18
6.0.0.321
2024-04-17
6.0.0.315
2024-04-16
6.0.0.314
2024-04-15
6.0.0.313
2024-04-14
6.0.0.312
2024-04-10
6.0.0.310
2024-04-04
6.0.0.308
2024-04-03
6.0.0.305
2024-04-02
6.0.0.303
2024-04-01
6.0.0.301
2024-03-29
6.0.0.299
2024-03-24
6.0.0.295
2024-03-22
6.0.0.294
2024-03-21
6.0.0.293
2024-03-17
Test TITLE
1 SS 34173 38936 38469 37438 0 50807 38167 35009 36161 55933 58078 0 33063 54021 32784 33745 33332 33704 33315 44239 31912 33513 34755 33833 33915 34340 34006 33045 32559 57686 33337
Compress Data over the Network
2 CS 45521 40753 44348 42219 76021 46022 40932 40425 41516 72419 75011 0 29436 49429 47544 42799 40803 47021 46380 56264 45521 45086 44574 48020 48347 48479 45362 44001 47721 46552 43671
Wrong results or unexpected errors while sorting a large data set
3 CS 2601 2902 2903 2887 3737 2884 2593 2583 2852 3366 3199 0 2581 2593 2609 2564 2582 2585 2581 2847 2601 2543 2611 2576 2586 2605 2619 2610 2580 2599 2589
exclude_filter doesn't work for <services></section> section of the Trace facility
4 SS 2395 2398 2443 2418 0 2745 2379 2372 2415 2495 2445 0 2394 2486 2390 2385 2381 2383 2362 2489 2395 2388 2404 2413 2370 2391 2417 2395 2382 2430 2396
exclude_filter doesn't work for <services></section> section of the Trace facility
5 CS 7529 11138 10125 11962 13988 7529 7457 7093 7413 14319 14485 0 6921 7467 7753 7571 7214 7169 6888 8319 7254 7013 11216 7984 6922 7264 9212 7594 7253 7363 7672
Ability to cancel waiting in lock manager
6 CS 2277 2295 2308 2290 3079 2510 2263 2274 2295 2518 2513 0 2260 2277 2283 2275 2251 2268 2266 2275 2246 2270 2257 2256 2265 2267 2302 2286 2289 2282 2298
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
7 SS 2131 2163 2145 2166 0 2358 2113 2130 2138 2219 2241 0 2131 2218 2121 2137 2161 2130 2132 2163 2130 2122 2151 2122 2128 2123 2161 2125 2120 2129 2112
FBSVCMGR connects to server as OS user name rather than value of ISC_USER environment variable
8 CS 11493 11496 11590 11493 14157 12387 11422 11380 11397 12678 12675 0 11421 11321 11449 11453 11316 11368 11350 11856 11514 11289 11541 11477 11451 11515 11563 11468 11659 11545 11688
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
9 CS 2994 3059 3044 3076 4241 2981 2979 3000 3003 3412 3401 0 2743 2994 2994 2952 3001 2744 2750 3057 2971 2977 3023 2987 2981 2743 3030 2981 2720 3008 2772
Allow output to trace explain plan form.
10 CS 18622 18661 18622 18524 22275 21274 18639 19556 18491 20585 20753 0 18669 18540 18346 18655 18308 18464 18397 18390 18456 18448 18672 18548 18359 18591 18557 18629 18729 18697 18635
Database shutdown can cause server crash if multiple attachments run EXECUTE STATEMENT
11 CS 679 753 772 807 1597 915 644 613 675 700 635 0 651 652 670 661 653 675 639 665 695 682 754 683 725 726 679 680 697 679 678
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
12 SS 389 464 408 444 0 542 390 380 378 613 534 0 388 362 413 373 387 371 407 335 367 378 394 362 372 414 421 396 382 564 375
IN/ANY/ALL predicates may cause sub-optimal (late filtering) execution of joins
13 CS 7063 6976 7456 6991 13937 6960 7413 7232 7315 10067 6582 0 7027 7111 7179 6700 7008 6712 6828 7169 6697 6456 7478 7482 6776 6854 7063 6989 8799 9031 10550
Slow changes on domain
14 SS 6580 6935 7127 6622 0 6298 6417 6171 6636 9632 7768 0 6509 6573 6597 6588 6408 6507 6308 6304 6352 6243 6611 6630 6515 6529 6617 6471 8625 7916 10073
Slow changes on domain
15 CS 421 463 483 512 1460 682 409 444 421 395 462 0 407 395 440 402 398 394 402 425 394 394 433 432 400 448 414 410 398 435 442
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
16 SS 235 273 304 299 0 398 221 212 245 382 348 0 207 234 235 220 243 232 204 331 223 224 238 216 240 224 236 236 220 203 238
Provide name of udf function for "arithmetic exception, numeric overflow, or string truncation"
17 CS 649 658 805 750 1857 915 679 680 683 739 623 0 676 645 660 640 652 649 640 618 608 585 645 591 611 723 611 592 657 600 573
Provide information about Global Commit Number, Commit Number of currently used database snapshot (if any) and Commit Numbers assigned to the committed transactions
18 CS 2607 2646 2640 2609 3782 2855 2629 2602 2587 2608 2597 0 2564 2634 2607 2608 2572 2584 2639 2580 2602 2572 2603 2589 2607 2630 2585 2608 2578 2648 2582
Trace could not work correctly with quoted file names in trace configurations
19 CS 2839 593 537 567 1038 743 480 2867 2860 2824 3443 0 2844 2829 2832 2849 2855 2838 2829 2852 2837 2850 2866 2839 2864 2849 2890 2837 2853 2828 2867
Efficient table scans for DBKEY-based range conditions
20 SS 2392 344 365 327 0 488 280 2380 2409 2772 2768 0 2422 2415 2408 2442 2388 2417 2384 2374 2400 2376 2422 2392 2399 2381 2400 2397 2383 2381 2393
Efficient table scans for DBKEY-based range conditions
21 CS 172644 175502 174628 169724 397466 178090 175801 174990 175259 237069 221796 0 166795 175520 167400 170660 166684 168901 168083 163443 168682 162629 0 0 0 0 0 0 0 0 0
Implement SQL standard FORMAT clause for CAST between string types and datetime types [CORE6507]
22 SS 175881 171632 172342 169871 0 183227 178489 179683 178739 249652 249117 0 178349 175881 177888 169603 165804 166876 166309 185623 166513 166844 0 0 0 0 0 0 0 0 0
Implement SQL standard FORMAT clause for CAST between string types and datetime types [CORE6507]
23 CS 146689 141346 137450 141845 301853 152061 152504 147193 149655 188880 177336 0 136793 140161 138660 141252 143903 148531 143675 147021 139834 138352 154509 150046 145029 146689 149041 146778 144647 147125 142922
Problem when restoring the database on FB 4.0 RC1 (gbak regression)
24 SS 11601 11302 11928 10361 0 11654 10305 10654 12457 15676 19003 0 10070 10024 12537 9525 11655 13753 19311 17018 11534 14090 9983 14280 11943 10097 12878 11549 9661 10658 10664
Indexed STARTING WITH execution is very slow with UNICODE collation
25 CS 642 656 668 714 1676 893 655 598 632 1187 595 0 623 664 614 624 625 603 642 638 598 592 645 645 648 630 650 682 608 648 568
PSQL and SQL profiler
26 SS 433 488 494 488 0 531 415 396 439 643 617 0 408 473 417 436 427 405 431 397 410 422 508 521 507 429 439 428 468 392 423
PSQL and SQL profiler
27 CS 4995 5033 4895 5290 11376 5693 5293 5091 5361 5039 5048 0 4791 4846 4868 4858 4852 4870 4543 4846 4839 4795 4981 5250 4999 4995 4941 5040 5069 5137 4879
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
28 SS 4179 4414 4254 4398 0 4737 4179 4055 4553 101 141 0 4099 4236 4126 4065 4011 4180 3992 4675 3922 4034 4458 4301 4388 4262 4281 4090 4156 4701 4112
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
29 CS 1111 1202 1193 1222 2781 1313 1141 1164 1076 1674 1109 0 1204 1072 1072 1071 1123 1048 1066 1092 1079 1072 1172 1118 1074 1188 1111 1047 1094 1185 1108
The partial index is not involved when filtering conditions through OR.
30 SS 645 807 714 791 0 829 684 620 669 1066 1044 0 619 658 616 614 585 690 567 720 647 581 640 654 597 617 644 701 592 549 628
The partial index is not involved when filtering conditions through OR.
31 CS 912 839 762 825 1771 912 1142 1151 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
32 SS 547 497 504 468 0 590 743 729 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Make protocol schemes case-insensitive
33 CS 450 522 483 450 1069 703 432 451 464 441 457 0 445 434 420 444 403 443 445 479 418 479 500 440 467 473 436 475 429 470 432
Basic test of RDB$BLOB_UTIL package functionality
34 SS 246 323 298 340 0 375 236 226 268 221 254 0 265 246 234 266 236 234 275 263 231 244 266 247 226 260 289 242 238 185 235
Basic test of RDB$BLOB_UTIL package functionality
35 CS 569 613 655 709 1320 736 559 557 589 607 625 0 550 543 545 548 560 558 545 509 541 542 632 569 558 564 574 578 623 629 586
CREATE DOMAIN - create two domain with same name
36 SS 321 361 385 384 0 462 304 297 322 285 287 0 337 307 313 312 322 305 318 451 320 321 328 325 317 343 354 318 322 263 325
CREATE DOMAIN - create two domain with same name
37 CS 6626 6726 6768 5777 6570 6626 6592 5650 6786 6700 5869 0 6513 6638 6556 6652 6604 6575 6694 6532 6591 6584 6713 5573 6761 6619 6647 69107 69317 69263 69237
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
38 SS 6851 7231 6205 6282 0 7043 6043 6016 7089 6570 6677 0 7029 5997 7035 7058 6022 6064 7032 6112 6114 6029 7146 6040 7033 6158 7025 69507 69580 68525 69502
Bugcheck 183 (wrong record length) could happen on replica database after UK violation on insert
39 CS 3369 3458 3461 3448 4314 3593 3382 3393 3522 3398 3448 0 3336 3322 3248 3262 3323 3283 3266 3364 3276 3360 3378 3336 3360 3423 3334 3369 3361 3403 3402
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
40 SS 2687 2783 2868 2868 0 2802 2650 2720 2665 3004 2992 0 2682 2686 2676 2673 2626 2655 2701 3038 2642 2591 2648 2699 2688 2689 2688 2655 2682 3006 2681
Check that trace plugin shows ROLE used in service attachment. Format: USER[:ROLE]
41 CS 834 867 951 934 1171 1064 878 829 820 881 917 0 791 786 723 769 834 772 770 791 776 837 884 780 780 848 856 788 776 841 840
Check ability to make connect to FB services and add/drop user
42 CS 29013 29340 29129 29493 32008 29255 28956 28889 29277 29192 29276 0 28858 28965 28782 28963 28911 29013 28877 29051 28851 28801 29159 29013 28987 29100 29052 29013 29046 29004 29089
External Connections Pool, functionality test 01

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-2966
http://tracker.firebirdsql.org/browse/core-3168
http://tracker.firebirdsql.org/browse/core-3323
http://tracker.firebirdsql.org/browse/core-3658
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-4451
http://tracker.firebirdsql.org/browse/core-5087
http://tracker.firebirdsql.org/browse/core-5236
http://tracker.firebirdsql.org/browse/core-5602
http://tracker.firebirdsql.org/browse/core-5876
http://tracker.firebirdsql.org/browse/core-5921
http://tracker.firebirdsql.org/browse/core-5991
http://tracker.firebirdsql.org/browse/core-6278
http://tracker.firebirdsql.org/browse/core-733
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/blob/test_rdb_blob_util_basic.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/domain/create/test_41.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/replication/test_bugcheck_in_rw_replica_after_conflicting_insert.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_role_in_service_attachment.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_user_management.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird/issues/2388
https://github.com/FirebirdSQL/firebird/issues/6785
https://github.com/FirebirdSQL/firebird/issues/6872
https://github.com/FirebirdSQL/firebird/issues/7086
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7804
https://github.com/FirebirdSQL/firebird/issues/8066

=== end of list ===