[
https://issues.apache.org/jira/browse/PIG-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13162943#comment-13162943
]
Daniel Dai commented on PIG-2385:
---------------------------------
Hi, Olga, the conditions are:
1. Use scalar
2. Multiple stores in script
3. Muti-query is off, or the multi-query is on, but you have "exec" in the
middle of script(the script before exec contains scalar definition)
When this happens, Pig does not even create empty directory.
> Store statements not getting processed
> --------------------------------------
>
> Key: PIG-2385
> URL: https://issues.apache.org/jira/browse/PIG-2385
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.1
> Reporter: Vivek Padmanabhan
> Assignee: Daniel Dai
> Priority: Critical
> Fix For: 0.10, 0.9.2, 0.11
>
> Attachments: PIG-2385-0.patch, PIG-2385-1.patch
>
>
> The actual script in which we got this issue is pretty big and complex. The
> script has total 4 STORE statements and one of the STORE statement is not
> getting executed.
> The script executes 3 sets of jobs (excluding one STORE which is not getting
> executed) consisting of 10, 11 and 19 jobs.
> The below script could be used to illustrate the issue but with Multiquery
> turned off;
> {code}
> A = LOAD 'input1' as (f1:chararray,f2:chararray,f3:chararray);
> Z = group A all;
> Z1 = foreach Z generate COUNT(A) as count;
> B = foreach A generate f1,f2,f3,(100-Z1.count) as diff;
> C = order B by diff;
> STORE C INTO 'output/C_out';
> D = DISTINCT C ;
> store D into 'output/F_out';
> {code}
> For this script, if run with Multiquery turned off, the Store command for D
> is not getting executed.
> I can see that the statements are getting parsed and LOStore created for D ,
> but still, it is not getting executed.
> The above script works fine with Pig 0.8.(This issue still exists in Trunk as
> well)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
