[
https://issues.apache.org/jira/browse/IMPALA-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16954086#comment-16954086
]
Tim Armstrong commented on IMPALA-6267:
---------------------------------------
I think the right fix here is actually to make the filter wait time unbounded
for mt_dop, so we don't need to handle this case.
> MT Scanners do not check runtime filters per-file before processing each split
> ------------------------------------------------------------------------------
>
> Key: IMPALA-6267
> URL: https://issues.apache.org/jira/browse/IMPALA-6267
> Project: IMPALA
> Issue Type: Sub-task
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Tim Armstrong
> Priority: Major
> Labels: perf
>
> The old implementation of HdfsScanNode re-checks partition filters per scan
> range in HdfsScanNode::ProcessSplit() before processing each scan range.
> HdfsScanNodeMt does not have similar logic.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
