[
https://issues.apache.org/jira/browse/PIG-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158265#comment-13158265
]
Daniel Dai commented on PIG-2385:
---------------------------------
We use processedStores to track how many stores we've already processed.
However, we counting different things. When we count how many stores we
processed, we use the plan after postProcess. When we skip stores in the
logical plan, we use the plan before postProcess. The difference is the former
count the scalar LOStore added by postProcess, the later not. We should make
the count on the same plan.
> Store statements not getting processed
> --------------------------------------
>
> Key: PIG-2385
> URL: https://issues.apache.org/jira/browse/PIG-2385
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Vivek Padmanabhan
> Priority: Critical
>
> The actual script in which we got this issue is pretty big and complex. The
> script has total 4 STORE statements and one of the STORE statement is not
> getting executed.
> The script executes 3 sets of jobs (excluding one STORE which is not getting
> executed) consisting of 10, 11 and 19 jobs.
> The below script could be used to illustrate the issue but with Multiquery
> turned off;
> {code}
> A = LOAD 'input1' as (f1:chararray,f2:chararray,f3:chararray);
> Z = group A all;
> Z1 = foreach Z generate COUNT(A) as count;
> B = foreach A generate f1,f2,f3,(100-Z1.count) as diff;
> C = order B by diff;
> STORE C INTO 'output/C_out';
> D = DISTINCT C ;
> store D into 'output/F_out';
> {code}
> For this script, if run with Multiquery turned off, the Store command for D
> is not getting executed.
> I can see that the statements are getting parsed and LOStore created for D ,
> but still, it is not getting executed.
> The above script works fine with Pig 0.8.(This issue still exists in Trunk as
> well)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
