01. Total results for each kind of outcome and server mode, for previous 30 runs
02. NEW CRASHES/BUGCHECKS: tests that caused FB abnormal termination for LAST run (0 rows)
03. NEW FAILS: tests which failed for LAST run (0 rows)
04. NEW ERRORS: tests which raised runtime error for LAST run (0 rows)
04. STILL FAILS: tests which fail for at least TWO LAST runs (0 rows)
05. NEW SLOWDOWN: tests with performance problem for LAST 5 runs (0 rows)
06. STILL SLOWDOWN: tests with performance problem for MORE THAN 5 last runs (50 rows)
[CURRENT] 07. Has fails: tests with at least one fail for previous 30 runs (11 rows)
08. Has runtime errors: tests with at least one runtime error for previous 30 runs (0 rows)
09. Has crashes/bugchecks: tests that caused FB abnormal termination for previous 30 runs (0 rows)
10. NEW PASSED: successful tests for last run and outcome = FAIL/ERROR/SKIPPED or absent previously (2 rows)
11. All tests: outcomes for previous 30 runs (2589 rows)
12. Skipped: tests which was intentionally excluded from execution (76 rows)

Generated UTC 25.04.2025 04:22
Tested: FB50.   Build / date: 5.0.3.1650-41dcaf4f / 2025.04.23;
Test machine: Linux 6.11.5-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.5-1 (2024-10-27); logical CPUs: 2; RAM: 7 Gb 
QA software: Python: 3.11.9; pytest: 7.4.4; firebird.driver: 1.10.9; firebird.Qa: 0.19.3 
Jump to the list of unique test names from this report
Jump to the list with last developing commits information

Test with at least one result = "FAIL" for last 30 runs:

NN Test name mode
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.26
5.0.3.1635
2025.03.24
5.0.3.1634
2025.03.20
5.0.3.1632
2025.03.13
5.0.3.1631
2025.03.12
5.0.3.1630
2025.03.07
5.0.3.1629
2025.03.05
5.0.3.1628
2025.03.04
5.0.3.1627
2025.02.26
5.0.3.1626
2025.02.25
5.0.3.1624
2025.02.24
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
Test TITLE
1 CS P P P P P P P P P P P P P P P P P P P P P P P P F P P P P P
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS P P P P F P P F P P P P P P P P P P F P P P P P P F P P P P
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
3 CS P P P P P P P P P P P P P P P P P P P P P F P P F P P P P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS P P P P P P P P P P P P P P P P P P P P P P P P P P P F P P
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
5 SS P P P P P P P P P P P P P P P P P P P P F P F P F P P P P P
Events in system attachments (like garbage collector) are not traced
6 CS P P F P X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
7 SS P P F P X X X X X X X X X X X X X X X X X X X X X X X X X X
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
8 SS P P P P P P P P P P P P P P P P P P P P F F X X X X X X X X
Segfault when already destroyed callback interface is used
9 CS P P P P P P P P P P P P P P P P P P P P P F P P F P P P P P
External Connections Pool, functionality test 01
10 SS P F P P P P P P P P P P P P P P P P P P P P P P P P P P P P
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.
11 CS P P P P P P P P P P P P P P P P P P P P P P P F P P P F P F
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

Elapsed time, milliseconds:

NN Test name mode median_ms
5.0.3.1650
2025.04.23
5.0.3.1649
2025.04.18
5.0.3.1648
2025.04.17
5.0.3.1647
2025.04.14
5.0.3.1646
2025.04.13
5.0.3.1643
2025.04.11
5.0.3.1642
2025.04.09
5.0.3.1641
2025.04.02
5.0.3.1639
2025.03.31
5.0.3.1638
2025.03.28
5.0.3.1636
2025.03.26
5.0.3.1635
2025.03.24
5.0.3.1634
2025.03.20
5.0.3.1632
2025.03.13
5.0.3.1631
2025.03.12
5.0.3.1630
2025.03.07
5.0.3.1629
2025.03.05
5.0.3.1628
2025.03.04
5.0.3.1627
2025.02.26
5.0.3.1626
2025.02.25
5.0.3.1624
2025.02.24
5.0.3.1622
2025.02.22
5.0.3.1619
2025.02.21
5.0.3.1617
2025.02.18
5.0.3.1616
2025.02.14
5.0.2.1615
2025.02.13
5.0.2.1614
2025.02.12
5.0.2.1613
2025.02.11
5.0.2.1611
2025.02.05
5.0.2.1610
2025.02.03
Test TITLE
1 CS 1043 6220 6948 5799 6082 4676 5033 4494 5196 4835 4846 5864 5407 5574 1030 976 970 804 930 1057 905 971 1016 988 923 1553 894 976 892 994 840
Significant performance regression of SIMILAR TO and SUBSTRING(SIMILAR) when pattern is taken from variable (rather than directly specified)
2 SS 462 2705 2738 2725 2706 2900 2708 2684 2992 2715 2682 2713 2716 2717 457 430 440 400 430 405 431 439 461 395 451 449 431 438 431 464 489
Services manager breaks long lines into 1023 bytes portions when using isc_info_svc_line in Service::query()
3 CS 3043 1026 1023 1020 1017 1015 1027 1026 1035 1014 1024 1021 1010 1018 3171 3080 3041 3045 3090 3118 3122 3073 3993 3074 2991 3681 3107 3090 3062 3073 3092
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
4 SS 2761 1023 1021 1028 1033 1012 1027 1024 1023 1016 1018 1016 1013 1017 2779 2830 2864 2807 2770 2870 2803 2782 2842 2801 2810 2777 2733 2764 2803 2758 2878
DROP DATABASE lead FB to hang if it is issued while DB encrypting/decrypting is in progress
5 SS 1538 4617 4522 4670 4582 4516 4572 4618 4580 4685 4666 4500 4486 4648 1490 1332 1389 1305 1259 1496 1218 1180 1581 1237 1175 1731 1456 1443 1398 1287 1273
Events in system attachments (like garbage collector) are not traced
6 CS 1732 1713 1585 1851 1752 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
7 SS 1278 1141 1248 1559 1309 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Unnest IN/ANY/EXISTS subqueries and optimize them using semi-join algorithm
8 SS 2473 2561 2656 2704 2764 2567 2487 2703 2867 2748 2459 2722 2455 2882 464 395 443 409 335 403 395 382 2350 0 0 0 0 0 0 0 0
Segfault when already destroyed callback interface is used
9 CS 810 30025 30191 30278 30135 29944 29994 29951 30288 30016 29844 29778 29708 30327 783 792 694 734 702 784 729 794 1191 797 696 670 773 819 774 802 735
External Connections Pool, functionality test 01
10 SS 520 940 920 1057 971 942 1117 1095 990 999 1124 926 1110 1018 490 496 432 476 427 490 463 406 472 427 462 581 508 533 446 411 494
Self-secutity DB: system privilege USER_MANAGEMENT must allow only to add/alter/drop user. No access to any user tables must be granted.
11 CS 55123 7627 7776 7818 7629 7567 7505 7579 7632 7651 7550 7381 7393 7679 57482 56567 55073 56382 55005 57115 55404 55594 71453 56559 55174 63319 56574 56132 55966 56324 56171
READ CONSISTENCY. MERGE must reject multiple matches, regardless on statement-level restart.

List of tests in this report:


https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/session/test_ext_conn_pool_01.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/syspriv/test_user_management_in_selfsec_db.py
https://github.com/FirebirdSQL/firebird-qa/tree/master/tests/functional/transactions/test_read_consist_sttm_merge_deny_multiple_matches.py
https://github.com/FirebirdSQL/firebird/issues/6875
https://github.com/FirebirdSQL/firebird/issues/7141
https://github.com/FirebirdSQL/firebird/issues/7200
https://github.com/FirebirdSQL/firebird/issues/7304
https://github.com/FirebirdSQL/firebird/issues/8061
https://github.com/FirebirdSQL/firebird/issues/8429
=== end of list ===

Last commits information (all timestamps in UTC):