Gabor Kaszab created IMPALA-12089:
-------------------------------------
Summary: Be able to skip pushing down a subset of the predicates
Key: IMPALA-12089
URL: https://issues.apache.org/jira/browse/IMPALA-12089
Project: IMPALA
Issue Type: Sub-task
Components: Frontend
Reporter: Gabor Kaszab
https://issues.apache.org/jira/browse/IMPALA-11701 introduced logic to skip
pushing down predicates to Impala scanners if they are already applied by
Iceberg and won't filter any further rows. This is an "all or nothing" approach
where we either skip pushing down all the predicates or we push down all of
them.
As a more sophisticated approach we should be able to push down a subset of the
predicates to Impala Scan nodes. For this we should be able to map Iceberg
predicates (returned from residual()) to Impala predicates. This might not be
that trivial as Iceberg sometimes doesn't return the exact same predicates as
it received through planFiles(). E.g. the object ID might be different making
the mapping more difficult.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)