[
https://issues.apache.org/jira/browse/HIVE-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13701777#comment-13701777
]
Yifeng Geng commented on HIVE-4345:
-----------------------------------
HIVE-4579's interface is enough for most file formats. This patch pushes down
the raw 'predicate' AST for the tables, then the fileformat and recordreader
decide how to use the AST. So it can be easily extended to implement
HIVE-4579's interface.
> Pushing down query conditions to support on-the-fly filtering at the file
> parsing
> ---------------------------------------------------------------------------------
>
> Key: HIVE-4345
> URL: https://issues.apache.org/jira/browse/HIVE-4345
> Project: Hive
> Issue Type: New Feature
> Components: Query Processor
> Affects Versions: 0.10.0
> Reporter: Yifeng Geng
> Labels: patch
> Fix For: 0.10.0
>
> Attachments: HIVE-4345.patch
>
>
> Serialize "predicate" conditions in query plan to MapredWork class, so the
> FileFormat class can use the conditions to do on-the-fly filtering on the
> files. It can improve the performance a lot for processsing certain binary
> files(NetCDF files for example).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
