Csaba Ringhofer created IMPALA-12157:
----------------------------------------

             Summary: Use predicates with OR in Parquet filtering
                 Key: IMPALA-12157
                 URL: https://issues.apache.org/jira/browse/IMPALA-12157
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend, Frontend
            Reporter: Csaba Ringhofer


Currently the Parquet scanner doesn't use predicates like "WHERE a=1 OR b=2" 
for dictionary and stat filtering.
The handling could look like this:
1. evaluate each conjunct at file level (file stats, dict filtering, bloom 
filters)
   - if all evaluate to false, skip the file
2. check the remaining conjunct's column indexes and create the union of the 
valid ranges 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to