[
https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741778#comment-13741778
]
Aniket Mokashi commented on PIG-3410:
-------------------------------------
I'm planning to play on my side what happens when we do For n times (run all
optimizers one after other). Right now, we have run all optimizers m times one
after the other, but that's not helpful.
Let's do this as first step.
> LimitOptimizer is applied before PartitionFilterOptimizer
> ---------------------------------------------------------
>
> Key: PIG-3410
> URL: https://issues.apache.org/jira/browse/PIG-3410
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: PIG-3410.patch
>
>
> Consider following script-
> {code}
> hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
> hcat_filter = FILTER hcat_load BY (part='Y');
> hcat_limited = limit hcat_filter 5;
> dump hcat_limited;
> {code}
> This script is not benefited from LimitOptimizer (pushing limit to loadfunc)
> because LimitOptimizer is applied before PartitionFilterOptimizer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
