[ 
https://issues.apache.org/jira/browse/IMPALA-12089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Rozsa resolved IMPALA-12089.
----------------------------------
    Resolution: Done

> Be able to skip pushing down a subset of the predicates
> -------------------------------------------------------
>
>                 Key: IMPALA-12089
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12089
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Frontend
>            Reporter: Gabor Kaszab
>            Assignee: Peter Rozsa
>            Priority: Major
>              Labels: impala-iceberg, performance
>
> https://issues.apache.org/jira/browse/IMPALA-11701 introduced logic to skip 
> pushing down predicates to Impala scanners if they are already applied by 
> Iceberg and won't filter any further rows. This is an "all or nothing" 
> approach where we either skip pushing down all the predicates or we push down 
> all of them.
> As a more sophisticated approach we should be able to push down a subset of 
> the predicates to Impala Scan nodes. For this we should be able to map 
> Iceberg predicates (returned from residual()) to Impala predicates. This 
> might not be that trivial as Iceberg sometimes doesn't return the exact same 
> predicates as it received through planFiles(). E.g. the object ID might be 
> different making the mapping more difficult.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to