01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (10 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (1 rows)
11. All tests: outcomes for previous 30 runs (2589 rows)
12. Skipped: tests which was intentionally excluded from execution (76 rows)

Generated UTC 17.05.2025 04:55
Tested: FB50.   Build / date: 5.0.3.1656-37a127ed / 2025.05.12;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.26
5.0.3.1635
2025.03.24
5.0.3.1634
2025.03.20
5.0.3.1632
2025.03.13
5.0.3.1631
2025.03.12
5.0.3.1630
2025.03.07
5.0.3.1629
2025.03.05
5.0.3.1628
2025.03.04
5.0.3.1627
2025.02.26
5.0.3.1626
2025.02.25
5.0.3.1624
2025.02.24
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P P F
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS P F P P P P P P P F P P F P P P P P P P P P P F P P P P P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
3 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P F
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS P P P P P P P P P P P P P P P P P P P P P P P P P F P F P F
Events in system attachments (like garbage collector) are not traced
5 CS P P P P P P P F P X X X X X X X X X X X X X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
6 SS P P P P P P P F P X X X X X X X X X X X X X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
7 SS P P P P P P P P P P P P P P P P P P P P P P P P P F F X X X
Segfault when already destroyed callback interface is used
8 CS P P P P P P P P P P P P P P P P P P P P P P P P P P F P P F
External Connections Pool, functionality test 01
9 SS P P P P P P F P P P P P P P P P P P P P P P P P P P P P P P
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.
10 CS P P P P P P P P P P P P P P P P P P P P P P P P P P P P F P
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1656
2025.05.12
5.0.3.1654
2025.05.11
5.0.3.1653
2025.05.07
5.0.3.1652
2025.05.06
5.0.3.1651
2025.05.05
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.26
5.0.3.1635
2025.03.24
5.0.3.1634
2025.03.20
5.0.3.1632
2025.03.13
5.0.3.1631
2025.03.12
5.0.3.1630
2025.03.07
5.0.3.1629
2025.03.05
5.0.3.1628
2025.03.04
5.0.3.1627
2025.02.26
5.0.3.1626
2025.02.25
5.0.3.1624
2025.02.24
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
Test TITLE
1 CS 4840 5959 6295 7231 6623 6379 5769 6948 5799 6082 4676 5033 4494 5196 4835 4846 5864 5407 5574 1030 976 970 804 930 1057 905 971 1016 988 923 1553
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS 2707 2760 3039 2745 2718 2734 2745 2738 2725 2706 2900 2708 2684 2992 2715 2682 2713 2716 2717 457 430 440 400 430 405 431 439 461 395 451 449
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
3 CS 1028 1032 1013 1030 1022 1014 1021 1023 1020 1017 1015 1027 1026 1035 1014 1024 1021 1010 1018 3171 3080 3041 3045 3090 3118 3122 3073 3993 3074 2991 3681
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS 4511 4762 4506 4692 4601 4524 4666 4522 4670 4582 4516 4572 4618 4580 4685 4666 4500 4486 4648 1490 1332 1389 1305 1259 1496 1218 1180 1581 1237 1175 1731
Events in system attachments (like garbage collector) are not traced
5 CS 1685 1668 1790 1652 1654 1685 1692 1585 1851 1752 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
6 SS 1299 1299 1374 1188 1274 1319 1093 1248 1559 1309 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
7 SS 2629 2666 2629 2758 2701 2675 2658 2656 2704 2764 2567 2487 2703 2867 2748 2459 2722 2455 2882 464 395 443 409 335 403 395 382 2350 0 0 0
Segfault when already destroyed callback interface is used
8 CS 29894 30297 30362 30168 30163 30379 30309 30191 30278 30135 29944 29994 29951 30288 30016 29844 29778 29708 30327 783 792 694 734 702 784 729 794 1191 797 696 670
External Connections Pool, functionality test 01
9 SS 939 1175 1179 936 946 1061 1123 920 1057 971 942 1117 1095 990 999 1124 926 1110 1018 490 496 432 476 427 490 463 406 472 427 462 581
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.
10 CS 7727 7628 8517 7480 7424 7595 7565 7776 7818 7629 7567 7505 7579 7632 7651 7550 7381 7393 7679 57482 56567 55073 56382 55005 57115 55404 55594 71453 56559 55174 63319
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_user_management_in_selfsec_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_merge_deny_multiple_matches.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8429
=== end of list ===

Last commits information (all timestamps in UTC):