[ 
https://issues.apache.org/jira/browse/HIVE-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13603487#comment-13603487
 ] 

Rajat Jain commented on HIVE-1662:
----------------------------------

We are following this patch because we wanted to implement something similar. 
Is it possible if we can do the pruning much before this step - in 
GenMapRedUtils.setTaskPlan. This will take care of the reducer estimation as 
well. Are there any issues with this?
                
> Add file pruning into Hive.
> ---------------------------
>
>                 Key: HIVE-1662
>                 URL: https://issues.apache.org/jira/browse/HIVE-1662
>             Project: Hive
>          Issue Type: New Feature
>            Reporter: He Yongqiang
>            Assignee: Navis
>         Attachments: HIVE-1662.D8391.1.patch, HIVE-1662.D8391.2.patch, 
> HIVE-1662.D8391.3.patch, HIVE-1662.D8391.4.patch
>
>
> now hive support filename virtual column. 
> if a file name filter presents in a query, hive should be able to only add 
> files which passed the filter to input paths.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to