01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
05. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
[CURRENT] 06. Has fails: tests with at least one fail for previous 30 runs (15 rows)
07. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
08. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
09. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
10. All tests: outcomes for previous 30 runs (2426 rows)
11. All tests: durations for previous 30 runs (4693 rows)
12. Skipped: tests which was intentionally excluded from execution (68 rows)

Generated 07.12.2023 06:03
Tested: FB50.   Build: 5.0.0.1295;   SS: 07.12.23 04:11:34 - 07.12.23 04:59:55;   CS: 07.12.23 05:01:50 - 07.12.23 06:00:37;
OS and hardware info:  Linux 6.1.0-1-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.4-1 (2023-01-07) ; logical CPUs: 2 ; total memory: 7.6 Gb 
QA-software: Python 3.10.9, virtual env; pytest: 7.2.1; firebird.driver: 1.8.0; Firebird.Qa: 0.17.2

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode 5.0.0.1295
2023-12-07		 5.0.0.1294
2023-12-05		 5.0.0.1292
2023-12-04		 5.0.0.1291
2023-12-03		 5.0.0.1284
2023-12-01		 5.0.0.1283
2023-11-30		 5.0.0.1282
2023-11-28		 5.0.0.1280
2023-11-27		 5.0.0.1278
2023-11-25		 5.0.0.1277
2023-11-23		 5.0.0.1274
2023-11-22		 5.0.0.1273
2023-11-21		 5.0.0.1272
2023-11-20		 5.0.0.1271
2023-11-19		 5.0.0.1270
2023-11-17		 5.0.0.1268
2023-11-16		 5.0.0.1267
2023-11-15		 5.0.0.1265
2023-11-13		 5.0.0.1264
2023-11-11		 5.0.0.1263
2023-11-09		 5.0.0.1261
2023-11-08		 5.0.0.1259
2023-11-02		 5.0.0.1258
2023-10-31		 5.0.0.1256
2023-10-29		 5.0.0.1254
2023-10-28		 5.0.0.1252
2023-10-26		 5.0.0.1250
2023-10-24		 5.0.0.1249
2023-10-21		 5.0.0.1248
2023-10-19		 5.0.0.1246
2023-10-16
Test TITLE
1
bugs core 3625 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P F F F P P P
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
2
bugs core 4236 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
3
bugs core 5222 
 tracker
 SS P P P P P F P P P P P P P P P P P P P P P P P P P P P P P P
SELECT WITH LOCK may raise unexpected update conflict errors under concurrent load
4
bugs core 5646 
 tracker
 SS P P P P P P P P F F F F F F F F F F F F F F F F F F F F F F
Parse error when compiling a statement causes memory leak until attachment is disconnected
5
bugs core 5771 
 tracker
 CS P P P P P P P P P P P P P P P P P P P P P P F F F F F F P P
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
6
bugs core 5771 
 tracker
 SS P P P P F P P P F P P P F P P F P F F F P F F F F F F F P P
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
7
bugs core 6049 
 tracker
 CS P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P
Builtin functions converting binary string to hexadecimal representation and vice versa
8
bugs core 6049 
 tracker
 SS P P P P P P P P P P P P P F P P P P P P P P P P P P P P P P
Builtin functions converting binary string to hexadecimal representation and vice versa
9
bugs core 6458 
 tracker
 CS P P P P P P P P P P P P P P P F P P P P P P P P P P P P P P
Regression: Cancel Query function no longer works
10
bugs gh 6875 
 tracker
 SS P P P P P P P P P P P P P P P P P P P P P P F P P P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7200 
 tracker
 CS P P P P F P P P P P P P P P P P P P P P P P P P F P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
12
bugs gh 7200 
 tracker
 SS P P P P P P P P P P F P P P P P P P P P P P P P P P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13
functional services user management 
 CS P P P P P P P P F P P P P P P P P P P P P P P P P P P P P P
Check ability to make connect to FB services and add/drop user
14
functional tabloid 333be4bf 
 CS P P P P P P P P P P P P P F X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
15
functional tabloid 333be4bf 
 SS P P P P P P P P P P P P P F X X X X X X X X X X X X X X X X
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

Elapsed time, milliseconds:

NN Test name mode median_ms 5.0.0.1295
2023-12-07		 5.0.0.1294
2023-12-05		 5.0.0.1292
2023-12-04		 5.0.0.1291
2023-12-03		 5.0.0.1284
2023-12-01		 5.0.0.1283
2023-11-30		 5.0.0.1282
2023-11-28		 5.0.0.1280
2023-11-27		 5.0.0.1278
2023-11-25		 5.0.0.1277
2023-11-23		 5.0.0.1274
2023-11-22		 5.0.0.1273
2023-11-21		 5.0.0.1272
2023-11-20		 5.0.0.1271
2023-11-19		 5.0.0.1270
2023-11-17		 5.0.0.1268
2023-11-16		 5.0.0.1267
2023-11-15		 5.0.0.1265
2023-11-13		 5.0.0.1264
2023-11-11		 5.0.0.1263
2023-11-09		 5.0.0.1261
2023-11-08		 5.0.0.1259
2023-11-02		 5.0.0.1258
2023-10-31		 5.0.0.1256
2023-10-29		 5.0.0.1254
2023-10-28		 5.0.0.1252
2023-10-26		 5.0.0.1250
2023-10-24		 5.0.0.1249
2023-10-21		 5.0.0.1248
2023-10-19		 5.0.0.1246
2023-10-16
Test TITLE
1
bugs core 3625 
 tracker
 CS 612 659 611 619 636 658 655 579 572 554 614 619 583 638 623 548 605 659 605 660 586 736 720 523 575 578 654 539 864 536 475
MON$IO_STATS doesn't report page writes performed asynchronously (at the AST level)
2
bugs core 4236 
 tracker
 CS 11362 11277 11326 11323 12140 11327 11465 11399 11285 11470 11351 11479 11481 11352 11303 11469 11418 11437 11335 11575 11317 11434 11372 11256 11424 11330 11470 11116 12248 11174 11100
Database shutdown is reported as successfully completed before all active connections are in fact interrupted
3
bugs core 5222 
 tracker
 SS 15341 15355 15355 15339 15346 15321 15379 15350 15332 15365 15322 15350 15314 15314 15348 15308 15330 15341 15366 15378 15339 15344 15374 15343 15353 15317 15342 15294 15264 15274 15261
SELECT WITH LOCK may raise unexpected update conflict errors under concurrent load
4
bugs core 5646 
 tracker
 SS 621 619 683 559 639 659 704 652 688 650 690 598 647 673 664 676 588 621 700 558 579 549 622 528 527 573 462 425 699 462 440
Parse error when compiling a statement causes memory leak until attachment is disconnected
5
bugs core 5771 
 tracker
 CS 1199 1200 1228 1169 1298 1147 1219 1335 1146 1255 1213 1161 1186 1312 1226 1214 1249 1198 1132 1177 1189 1260 1244 1137 1125 1207 1167 1032 1822 997 1001
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
6
bugs core 5771 
 tracker
 SS 741 782 782 789 694 744 780 684 689 783 738 758 798 724 737 807 725 780 715 778 724 789 767 698 738 708 750 647 754 588 566
Restore (without replace) when database already exists crashes gbak or Firebird (when run through service manager)
7
bugs core 6049 
 tracker
 CS 433 411 421 396 479 407 391 432 446 466 453 392 472 452 496 440 460 436 431 453 369 479 473 429 435 466 431 384 366 390 380
Builtin functions converting binary string to hexadecimal representation and vice versa
8
bugs core 6049 
 tracker
 SS 274 265 308 269 275 284 268 254 310 318 283 292 300 250 289 296 260 281 265 282 273 285 321 270 241 276 260 257 212 218 238
Builtin functions converting binary string to hexadecimal representation and vice versa
9
bugs core 6458 
 tracker
 CS 4353 4345 4336 4392 4314 4392 4372 4350 4367 4360 4354 4408 4315 4350 4395 4341 6580 4372 4334 4352 4374 4418 4375 4331 4353 4364 4354 4283 4288 4298 4280
Regression: Cancel Query function no longer works
10
bugs gh 6875 
 tracker
 SS 3996 4226 3870 4153 4357 3923 3963 4688 4072 3929 4294 3909 3969 4004 3701 4165 4377 4151 4508 3835 3965 3970 4100 4300 4032 3989 3555 3851 3868 3861 4013
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
11
bugs gh 7200 
 tracker
 CS 3806 5420 3880 3867 2754 4764 3019 4038 3808 2854 3922 3802 2961 3824 3880 3921 3920 2772 3888 3812 3761 3965 3638 3804 3788 3995 3476 3451 2428 3770 3259
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
12
bugs gh 7200 
 tracker
 SS 3286 4492 3302 3230 3121 3384 3121 3338 3291 3239 2144 3454 3301 3303 3303 3293 3307 3156 3282 3445 3141 3261 3296 3355 2219 3301 3090 3069 3112 2981 2691
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
13
functional services user management 
 CS 816 872 767 823 952 730 962 796 829 826 802 873 874 809 793 878 751 840 907 797 863 878 924 809 789 895 769 706 668 710 645
Check ability to make connect to FB services and add/drop user
14
functional tabloid 333be4bf 
 CS 1416 1411 1497 1509 1514 1441 1360 1405 1421 1398 1426 1370 1411 1435 691 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range
15
functional tabloid 333be4bf 
 SS 1088 1019 1081 1047 1109 1088 1096 1098 1056 1125 1058 1098 1088 1103 536 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Change error by warning in the case when isc_dpb_parallel_workers value is not at valid range

List of tests in this report:


http://tracker.firebirdsql.org/browse/core-3625
http://tracker.firebirdsql.org/browse/core-4236
http://tracker.firebirdsql.org/browse/core-5222
http://tracker.firebirdsql.org/browse/core-5646
http://tracker.firebirdsql.org/browse/core-5771
http://tracker.firebirdsql.org/browse/core-6049
http://tracker.firebirdsql.org/browse/core-6458
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/services/test_user_management.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/tabloid/test_333be4bf.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7200

=== end of list ===