[
https://issues.apache.org/jira/browse/PIG-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13741240#comment-13741240
]
Aniket Mokashi commented on PIG-3410:
-------------------------------------
[~cheolsoo], yes, I did run full test suite. None of failure are related to
this (there were a few due to pig not cleaning up files in our environment).
I haven't tried e2e, do you have a setup for that?
> LimitOptimizer is applied before PartitionFilterOptimizer
> ---------------------------------------------------------
>
> Key: PIG-3410
> URL: https://issues.apache.org/jira/browse/PIG-3410
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.11.1
> Reporter: Aniket Mokashi
> Assignee: Aniket Mokashi
> Attachments: PIG-3410.patch
>
>
> Consider following script-
> {code}
> hcat_load = LOAD 'X' using org.apache.hcatalog.pig.HCatLoader();
> hcat_filter = FILTER hcat_load BY (part='Y');
> hcat_limited = limit hcat_filter 5;
> dump hcat_limited;
> {code}
> This script is not benefited from LimitOptimizer (pushing limit to loadfunc)
> because LimitOptimizer is applied before PartitionFilterOptimizer.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira