Show cross-report outcomes.

Annotation type Annotation details
2 @message
Performance problem

assert   
    RATIO_FOR_1E1 Acceptable
  - RATIO_FOR_1E2 Acceptable
  + RATIO_FOR_1E2 Regression /* perf_issue_tag */: ratio = 6.6170 > 3.0000
    RATIO_FOR_1E3 Acceptable
    RATIO_FOR_1E4 Acceptable
    RATIO_FOR_1E5 Acceptable

LOG DETAILS:

2024-08-25 19:42:54.099
2024-08-25 19:42:54.114 act = <firebird.qa.plugin.Action object at [hex]>
2024-08-25 19:42:54.126
2024-08-25 19:42:54.135 @pytest.mark.version('>=3')
2024-08-25 19:42:54.145 def test_1(act: Action):
2024-08-25 19:42:54.153 act.expected_stdout = expected_stdout
2024-08-25 19:42:54.160 act.execute(combine_output = True)
2024-08-25 19:42:54.284 >       assert act.clean_stdout == act.clean_expected_stdout
2024-08-25 19:42:54.299 E       assert
2024-08-25 19:42:54.311 E           RATIO_FOR_1E1 Acceptable
2024-08-25 19:42:54.320 E         - RATIO_FOR_1E2 Acceptable
2024-08-25 19:42:54.328 E         + RATIO_FOR_1E2 Regression /* perf_issue_tag */: ratio = 6.6170 > 3.0000
2024-08-25 19:42:54.338 E           RATIO_FOR_1E3 Acceptable
2024-08-25 19:42:54.350 E           RATIO_FOR_1E4 Acceptable
2024-08-25 19:42:54.360 E           RATIO_FOR_1E5 Acceptable
2024-08-25 19:42:54.373
2024-08-25 19:42:54.387 tests/bugs/core_0214_test.py:195: AssertionError
2024-08-25 19:42:54.399 ---------------------------- Captured stdout setup -----------------------------
2024-08-25 19:42:54.410 Creating db: localhost:/var/tmp/qa_2024/test_145/test.fdb [page_size=None, sql_dialect=None, charset='NONE', user=SYSDBA, password=masterkey]
3 #text
act = <firebird.qa.plugin.Action pytest object at [hex]>

    @pytest.mark.version('>=3')
    def test_1(act: Action):
        act.expected_stdout = expected_stdout
        act.execute(combine_output = True)
>       assert act.clean_stdout == act.clean_expected_stdout
E       assert   
E           RATIO_FOR_1E1 Acceptable
E         - RATIO_FOR_1E2 Acceptable
E         + RATIO_FOR_1E2 Regression /* perf_issue_tag */: ratio = 6.6170 > 3.0000
E           RATIO_FOR_1E3 Acceptable
E           RATIO_FOR_1E4 Acceptable
E           RATIO_FOR_1E5 Acceptable

tests/bugs/core_0214_test.py:195: AssertionError
Full history of outcomes and elapsed time, ms:
NN SNAP_INFO CS_outcome SS_outcome CS_run_time SS_run_time CS_run_beg CS_run_end SS_run_beg SS_run_end
1 3.0.13.33794 2024.10.15 abe09 P P 11429 10930 2024.11.23 06:07:28.217 2024.11.23 06:07:39.646 2024.11.23 05:31:39.587 2024.11.23 05:31:50.517
2 3.0.13.33793 2024.10.04 82ccc P P 11706 10672 2024.10.14 04:00:18.151 2024.10.14 04:00:29.857 2024.10.14 03:22:17.342 2024.10.14 03:22:28.014
3 3.0.13.33792 2024.08.31 d8791 P P 11690 12133 2024.10.03 09:04:46.690 2024.10.03 09:04:58.380 2024.10.03 08:24:23.180 2024.10.03 08:24:35.313
4 3.0.13.33787 2024.08.17 2e0d6 F P 31241 32366 2024.08.25 14:16:35.158 2024.08.25 14:17:06.399 2024.08.25 12:48:04.555 2024.08.25 12:48:36.921
5 3.0.13.33787 2024.08.09 df740 P P 15223 14233 2024.08.16 12:17:02.167 2024.08.16 12:17:17.390 2024.08.16 11:31:01.417 2024.08.16 11:31:15.650
6 3.0.12.33746 2024.07.15 11dd4 P P 10403 9512 2024.08.09 12:10:36.797 2024.08.09 12:10:47.200 2024.08.09 11:25:33.753 2024.08.09 11:25:43.265
7 3.0.12.33746 2024.06.11 8a5eb P P 14639 13498 2024.07.15 10:10:15.897 2024.07.15 10:10:30.536 2024.07.15 09:30:25.010 2024.07.15 09:30:38.508
8 3.0.12.33744 2024.05.09 9cf37 P P 11150 9805 2024.05.12 15:18:21.646 2024.05.12 15:18:32.796 2024.05.12 14:42:40.713 2024.05.12 14:42:50.518
9 3.0.12.33744 2024.04.20 af6b2 P P 11148 10237 2024.05.08 16:35:44.568 2024.05.08 16:35:55.716 2024.05.08 16:01:46.948 2024.05.08 16:01:57.185

Elapsed time, ms. Chart for last 9 runs:

Last commits information (all timestamps in UTC):