Show cross-report outcomes.

Annotation type Annotation details
2 @message
Performance problem

assert   
    RATIO_FOR_1E1 Acceptable
    RATIO_FOR_1E2 Acceptable
  - RATIO_FOR_1E3 Acceptable
  + RATIO_FOR_1E3 Regression /* perf_issue_tag */: ratio = 9.3444 > 3.0000
    RATIO_FOR_1E4 Acceptable
    RATIO_FOR_1E5 Acceptable

LOG DETAILS:

2024-09-02 14:48:29.931
2024-09-02 14:48:29.940 act = <firebird.qa.plugin.Action object at [hex]>
2024-09-02 14:48:29.954
2024-09-02 14:48:29.964 @pytest.mark.version('>=3')
2024-09-02 14:48:29.974 def test_1(act: Action):
2024-09-02 14:48:29.981 act.expected_stdout = expected_stdout
2024-09-02 14:48:29.988 act.execute(combine_output = True)
2024-09-02 14:48:29.995 >       assert act.clean_stdout == act.clean_expected_stdout
2024-09-02 14:48:30.003 E       assert
2024-09-02 14:48:30.009 E           RATIO_FOR_1E1 Acceptable
2024-09-02 14:48:30.016 E           RATIO_FOR_1E2 Acceptable
2024-09-02 14:48:30.022 E         - RATIO_FOR_1E3 Acceptable
2024-09-02 14:48:30.029 E         + RATIO_FOR_1E3 Regression /* perf_issue_tag */: ratio = 9.3444 > 3.0000
2024-09-02 14:48:30.037 E           RATIO_FOR_1E4 Acceptable
2024-09-02 14:48:30.045 E           RATIO_FOR_1E5 Acceptable
2024-09-02 14:48:30.054
2024-09-02 14:48:30.062 tests/bugs/core_0214_test.py:195: AssertionError
2024-09-02 14:48:30.071 ---------------------------- Captured stdout setup -----------------------------
2024-09-02 14:48:30.078 Creating db: localhost:/var/tmp/qa_2024/test_145/test.fdb [page_size=None, sql_dialect=None, charset='NONE', user=SYSDBA, password=masterkey]
3 #text
act = <firebird.qa.plugin.Action pytest object at [hex]>

    @pytest.mark.version('>=3')
    def test_1(act: Action):
        act.expected_stdout = expected_stdout
        act.execute(combine_output = True)
>       assert act.clean_stdout == act.clean_expected_stdout
E       assert   
E           RATIO_FOR_1E1 Acceptable
E           RATIO_FOR_1E2 Acceptable
E         - RATIO_FOR_1E3 Acceptable
E         + RATIO_FOR_1E3 Regression /* perf_issue_tag */: ratio = 9.3444 > 3.0000
E           RATIO_FOR_1E4 Acceptable
E           RATIO_FOR_1E5 Acceptable

tests/bugs/core_0214_test.py:195: AssertionError
Full history of outcomes and elapsed time, ms:
NN SNAP_INFO CS_outcome SS_outcome CS_run_time SS_run_time CS_run_beg CS_run_end SS_run_beg SS_run_end
1 3.0.13.33794 2024.10.23 e2a6b P P 12739 12010 2024.11.29 05:07:32.068 2024.11.29 05:07:44.807 2024.11.29 04:31:57.808 2024.11.29 04:32:09.818
2 3.0.13.33793 2024.09.02 3e627 P P 11884 11139 2024.10.23 07:01:11.788 2024.10.23 07:01:23.672 2024.10.23 06:23:33.021 2024.10.23 06:23:44.160
3 3.0.13.33792 2024.08.30 d9f38 F F 30459 30844 2024.09.02 09:56:54.566 2024.09.02 09:57:25.025 2024.09.02 08:44:07.923 2024.09.02 08:44:38.767
4 3.0.13.33791 2024.08.21 c8a36 P P 25019 24934 2024.08.30 09:40:56.641 2024.08.30 09:41:21.660 2024.08.30 08:29:26.073 2024.08.30 08:29:51.007
5 3.0.13.33790 2024.08.20 3bf52 P P 23341 23292 2024.08.21 09:12:22.495 2024.08.21 09:12:45.836 2024.08.21 08:09:30.468 2024.08.21 08:09:53.760
6 3.0.13.33789 2024.08.09 7933a P P 15380 14689 2024.08.19 05:46:56.246 2024.08.19 05:47:11.626 2024.08.19 05:01:52.686 2024.08.19 05:02:07.375
7 3.0.12.33787 2024.08.06 bf180 P P 15775 13951 2024.08.09 05:34:14.203 2024.08.09 05:34:29.978 2024.08.09 04:49:34.802 2024.08.09 04:49:48.753
8 3.0.12.33784 2024.08.01 cd857 P P 13861 14253 2024.08.06 04:38:20.641 2024.08.06 04:38:34.502 2024.08.06 04:00:04.427 2024.08.06 04:00:18.680
9 3.0.12.33779 2024.07.31 ae35d P P 14969 14371 2024.08.01 04:36:56.939 2024.08.01 04:37:11.908 2024.08.01 03:58:54.874 2024.08.01 03:59:09.245
10 3.0.12.33778 2024.07.21 4680d P P 15162 14050 2024.07.30 04:34:00.141 2024.07.30 04:34:15.303 2024.07.30 03:56:06.888 2024.07.30 03:56:20.938
11 3.0.12.33777 2024.07.19 8e912 P P 15044 13945 2024.07.21 04:36:07.497 2024.07.21 04:36:22.541 2024.07.21 03:58:10.791 2024.07.21 03:58:24.736
12 3.0.12.33766 2024.07.13 b5086 P P 14399 14502 2024.07.19 04:28:49.940 2024.07.19 04:29:04.339 2024.07.19 03:51:13.403 2024.07.19 03:51:27.905
13 3.0.12.33765 2024.07.10 06f2a P P 15084 13686 2024.07.13 04:31:31.286 2024.07.13 04:31:46.370 2024.07.13 03:52:36.226 2024.07.13 03:52:49.912
14 3.0.12.33764 2024.06.18 4d0c0 P P 13588 13089 2024.07.10 04:21:18.052 2024.07.10 04:21:31.640 2024.07.10 03:44:39.717 2024.07.10 03:44:52.806
15 3.0.12.33761 2024.06.17 b259d P P 13081 13384 2024.06.18 04:22:26.947 2024.06.18 04:22:40.028 2024.06.18 03:45:08.317 2024.06.18 03:45:21.701
16 3.0.12.33758 2024.06.14 4f9bc P P 14310 13829 2024.06.17 04:17:04.114 2024.06.17 04:17:18.424 2024.06.17 03:39:11.536 2024.06.17 03:39:25.365
17 3.0.12.33757 2024.06.13 c7a1c P P 9575 8862 2024.06.14 04:34:24.778 2024.06.14 04:34:34.353 2024.06.14 04:01:38.955 2024.06.14 04:01:47.817
18 3.0.12.33744 2024.04.19 ecf36 P P 11058 11206 2024.05.08 15:14:13.174 2024.05.08 15:14:24.232 2024.05.08 14:41:22.395 2024.05.08 14:41:33.601

Elapsed time, ms. Chart for last 18 runs:

Last commits information (all timestamps in UTC):