[
https://issues.apache.org/jira/browse/IMPALA-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17053662#comment-17053662
]
Thomas Tauber-Marshall commented on IMPALA-9450:
------------------------------------------------
Fwiw, the error is being caused by the fact that not all of the filters arrived
by the timeout (and therefore weren't applied, leading to a higher number of
rows getting processed on the probe side of the join), see the line in the
profile that says "Not all filters arrived"
In the past when we've seen this issue we've just bumped
RUNTIME_FILTER_WAIT_TIME_MS for the tests, but of course we don't necessarily
want to just keep bumping the timeout since there really should be a bound on
how long this takes.
Might be worth trying to test and see if any of the recent runtime filter
related changes caused a slowdown in filter propagation, and if so if there's
anything that we can do to improve the situation.
Its possible, though, that the right thing to do would be to just bump the
timeout again and leave any improvements in this area to future work.
> test_min_max_filters failed with AssertionError: Aggregation of SUM over
> ProbeRows did not match expected results.
> -------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-9450
> URL: https://issues.apache.org/jira/browse/IMPALA-9450
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Reporter: Tim Armstrong
> Assignee: Fang-Yu Rao
> Priority: Critical
> Labels: flaky
> Attachments: full-error.txt
>
>
> [~fangyurao] can you take a look?
> {noformat}
> query_test.test_runtime_filters.TestMinMaxFilters.test_min_max_filters[protocol:
> beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
> 'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
> 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
> kudu/none] (from pytest)
> Failing for the past 1 build (Since Failed#285 )
> Took 10 min.
> add description
> Error Message
> query_test/test_runtime_filters.py:173: in test_min_max_filters
> test_file_vars={'$RUNTIME_FILTER_WAIT_TIME_MS': str(WAIT_TIME_MS)})
> common/impala_test_suite.py:715: in run_test_case
> ...
> E AssertionError: Aggregation of SUM over ProbeRows did not match expected
> results.
> E EXPECTED VALUE:
> E 643
> E
> E ACTUAL VALUE:
> E 661
> {noformat}
> [^full-error.txt] includes the full profile in the error message.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
