[
https://issues.apache.org/jira/browse/IMPALA-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Rozsa resolved IMPALA-12089.
----------------------------------
Resolution: Done
> Be able to skip pushing down a subset of the predicates
> -------------------------------------------------------
>
> Key: IMPALA-12089
> URL: https://issues.apache.org/jira/browse/IMPALA-12089
> Project: IMPALA
> Issue Type: Sub-task
> Components: Frontend
> Reporter: Gabor Kaszab
> Assignee: Peter Rozsa
> Priority: Major
> Labels: impala-iceberg, performance
>
> https://issues.apache.org/jira/browse/IMPALA-11701 introduced logic to skip
> pushing down predicates to Impala scanners if they are already applied by
> Iceberg and won't filter any further rows. This is an "all or nothing"
> approach where we either skip pushing down all the predicates or we push down
> all of them.
> As a more sophisticated approach we should be able to push down a subset of
> the predicates to Impala Scan nodes. For this we should be able to map
> Iceberg predicates (returned from residual()) to Impala predicates. This
> might not be that trivial as Iceberg sometimes doesn't return the exact same
> predicates as it received through planFiles(). E.g. the object ID might be
> different making the mapping more difficult.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)