Alex Levenson created PARQUET-37:
------------------------------------
Summary: Record filtering in the filter2 API could possibly short
circuit
Key: PARQUET-37
URL: https://issues.apache.org/jira/browse/PARQUET-37
Project: Parquet
Issue Type: Improvement
Components: parquet-mr
Reporter: Alex Levenson
Priority: Minor
Record level filtering in the filter2 api still requires visiting every value
of the record. We may be able to short circuit as soon as the filter predicate
reaches a known state.
Another approach would be to figure out how to get essentially random access to
the values referenced by the predicate and check them first. This could be
tricky because it would require re-structuring the assembly algorithm.
--
This message was sent by Atlassian JIRA
(v6.2#6252)