[
https://issues.apache.org/jira/browse/PIG-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12999654#comment-12999654
]
Ashutosh Chauhan commented on PIG-1871:
---------------------------------------
In Pig 0.8 following succeeds:
a = load 'mydata' USING MyLoader();
b0 = filter a BY
( (ds < '20091103' )
or (action == 'continue' )
);
c = foreach b0 generate ds, action, age, data;
store c into ':OUTPATH:';
This implies that in 0.8, b0 and b got combined first. Then, Pig tried to weed
out partitioning columns from the combined expression and bailed out. But
clearly, b0 can be pushed up and is separated by 'AND' in combined expression
so should have been pushed up. There will still be the cases where partition
columns can't be weeded out easily from an expression. In those cases, don't
try to push up anything and continue.
> Dont throw exception if partition filters cannot be pushed up.
> ----------------------------------------------------------------
>
> Key: PIG-1871
> URL: https://issues.apache.org/jira/browse/PIG-1871
> Project: Pig
> Issue Type: Bug
> Reporter: Ashutosh Chauhan
> Priority: Minor
> Fix For: 0.9.0
>
>
> Instead don't try to push partition filters up and continue execution.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
