Jump to: output_first_mismatch    outcomes_full_history    elapsed_time_chart
Show cross-report outcomes.

Annotation type Annotation details
1 @message
Performance problem

assert   
    RATIO_FOR_1E1 Acceptable
    RATIO_FOR_1E2 Acceptable
    RATIO_FOR_1E3 Acceptable
    RATIO_FOR_1E4 Acceptable
  - RATIO_FOR_1E5 Acceptable
  + RATIO_FOR_1E5 Regression /* perf_issue_tag */: ratio = 10.0000 > 3.0000

LOG DETAILS:

2024-10-15 15:49:38.656
2024-10-15 15:49:38.656 act = <firebird.qa.plugin.Action object at [hex]>
2024-10-15 15:49:38.656
2024-10-15 15:49:38.656     @pytest.mark.version('>=3')
2024-10-15 15:49:38.656     def test_1(act: Action):
2024-10-15 15:49:38.656         act.expected_stdout = expected_stdout
2024-10-15 15:49:38.656         act.execute(combine_output = True)
2024-10-15 15:49:38.656 >       assert act.clean_stdout == act.clean_expected_stdout
2024-10-15 15:49:38.656 E       assert
2024-10-15 15:49:38.656 E           RATIO_FOR_1E1 Acceptable
2024-10-15 15:49:38.656 E           RATIO_FOR_1E2 Acceptable
2024-10-15 15:49:38.656 E           RATIO_FOR_1E3 Acceptable
2024-10-15 15:49:38.657 E           RATIO_FOR_1E4 Acceptable
2024-10-15 15:49:38.657 E         - RATIO_FOR_1E5 Acceptable
2024-10-15 15:49:38.657 E         + RATIO_FOR_1E5 Regression /* perf_issue_tag */: ratio = 10.0000 > 3.0000
2024-10-15 15:49:38.657
2024-10-15 15:49:38.657 tests\bugs\core_0214_test.py:195: AssertionError
2024-10-15 15:49:38.657 ---------------------------- Captured stdout setup ----------------------------
2024-10-15 15:49:38.657 Creating db: localhost:H:\QA\temp\qa2024.tmp\fbqa\test_145\test.fdb [page_size=None, sql_dialect=None, charset='NONE', user=SYSDBA, password=masterkey]
2 #text
act = <firebird.qa.plugin.Action pytest object at [hex]>

    @pytest.mark.version('>=3')
    def test_1(act: Action):
        act.expected_stdout = expected_stdout
        act.execute(combine_output = True)
>       assert act.clean_stdout == act.clean_expected_stdout
E       assert   
E           RATIO_FOR_1E1 Acceptable
E           RATIO_FOR_1E2 Acceptable
E           RATIO_FOR_1E3 Acceptable
E           RATIO_FOR_1E4 Acceptable
E         - RATIO_FOR_1E5 Acceptable
E         + RATIO_FOR_1E5 Regression /* perf_issue_tag */: ratio = 10.0000 > 3.0000

tests\bugs\core_0214_test.py:195: AssertionError
Full history of outcomes and elapsed time, ms:
NN SNAP_INFO CS_outcome SS_outcome CS_run_time SS_run_time CS_run_beg CS_run_end SS_run_beg SS_run_end
1 3.0.13.33795 2024.11.24 b8847 P P 2015 1667 2024.11.28 11:43:25.230 2024.11.28 11:43:27.245 2024.11.28 11:14:04.293 2024.11.28 11:14:05.960
2 3.0.13.33794 2024.10.15 abe09 P P 2056 1589 2024.11.22 11:42:22.219 2024.11.22 11:42:24.275 2024.11.22 11:13:05.961 2024.11.22 11:13:07.550
3 3.0.13.33793 2024.10.14 f831a F P 2536 1575 2024.10.15 12:09:40.929 2024.10.15 12:09:43.465 2024.10.15 11:40:38.222 2024.10.15 11:40:39.797
4 3.0.13.33793 2024.10.04 82ccc P P 1974 1609 2024.10.12 12:09:01.066 2024.10.12 12:09:03.040 2024.10.12 11:40:01.978 2024.10.12 11:40:03.587
5 3.0.13.33792 2024.08.31 d8791 P P 2355 1571 2024.10.03 12:16:20.090 2024.10.03 12:16:22.445 2024.10.03 11:46:34.248 2024.10.03 11:46:35.819
6 3.0.13.33787 2024.08.23 8ee81 P P 2836 1673 2024.09.01 12:24:24.047 2024.09.01 12:24:26.883 2024.09.01 11:52:21.680 2024.09.01 11:52:23.353
7 3.0.13.33787 2024.08.09 df740 P P 2461 1661 2024.08.23 12:21:07.120 2024.08.23 12:21:09.581 2024.08.23 11:49:00.430 2024.08.23 11:49:02.091
8 3.0.12.33746 2024.07.15 11dd4 P P 1957 1722 2024.08.09 11:41:24.649 2024.08.09 11:41:26.606 2024.08.09 11:09:25.309 2024.08.09 11:09:27.031
9 3.0.12.33746 2024.06.11 8a5eb P P 1763 1672 2024.07.15 10:37:43.861 2024.07.15 10:37:45.624 2024.07.15 10:09:56.461 2024.07.15 10:09:58.133
10 3.0.12.33745 2024.05.21 301a7 P P 1656 1360 2024.05.25 07:36:35.470 2024.05.25 07:36:37.126 2024.05.25 07:12:05.071 2024.05.25 07:12:06.431
11 3.0.12.33745 2024.05.09 9cf37 P P 1703 1523 2024.05.21 07:36:36.349 2024.05.21 07:36:38.052 2024.05.21 07:11:51.210 2024.05.21 07:11:52.733
12 3.0.12.33744 2024.04.20 af6b2 P P 1641 1360 2024.05.11 07:33:27.898 2024.05.11 07:33:29.539 2024.05.11 07:09:32.317 2024.05.11 07:09:33.677
13 3.0.12.33740 2024.04.06 c6cdd P P 1640 1344 2024.04.21 01:48:00.500 2024.04.21 01:48:02.140 2024.04.21 01:24:29.190 2024.04.21 01:24:30.534
14 3.0.12.33726 2024.03.29 1fac6 P P 1656 1359 2024.04.05 06:43:56.787 2024.04.05 06:43:58.443 2024.04.05 06:20:44.966 2024.04.05 06:20:46.325
15 3.0.12.33726 2024.03.11 456ca P P 1593 1359 2024.03.29 12:26:11.764 2024.03.29 12:26:13.357 2024.03.29 12:03:01.947 2024.03.29 12:03:03.306

Elapsed time, ms. Chart for last 15 runs:

Last commits information (all timestamps in UTC):