[
https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741794#comment-13741794
]
Aniket Mokashi commented on PIG-3410:
-------------------------------------
Sorry, I wanted to say that we should solve the real problem (that order of
optimizers matter) in another jira. Please review if this looks good.
> LimitOptimizer is applied before PartitionFilterOptimizer
> ---------------------------------------------------------
>
> Key: PIG-3410
> URL: https://issues.apache.org/jira/browse/PIG-3410
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: PIG-3410.patch
>
>
> Consider following script-
> {code}
> hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
> hcat_filter = FILTER hcat_load BY (part='Y');
> hcat_limited = limit hcat_filter 5;
> dump hcat_limited;
> {code}
> This script is not benefited from LimitOptimizer (pushing limit to loadfunc)
> because LimitOptimizer is applied before PartitionFilterOptimizer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira