[
https://issues.apache.org/jira/browse/PIG-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12586490#action_12586490
]
Xu Zhang commented on PIG-186:
------------------------------
The "No such file or directory" exception is gone, but I got "broken pipe"
exception instead. See the tasks UI for job_200804041056_0346 .
> Pig appears to hang with this Pig script
> ----------------------------------------
>
> Key: PIG-186
> URL: https://issues.apache.org/jira/browse/PIG-186
> Project: Pig
> Issue Type: Bug
> Reporter: Xu Zhang
> Assignee: Arun C Murthy
> Priority: Critical
> Attachments: DataGuaranteeTest.pl
>
>
> Pig stoped at progress 56%. It seemed there had been exceptions on the the
> reduce task trackers (see below). But waiting for 20 reduce tasks to time
> out themselves is excruciating and blocking my other tests.
> Here is my Pig script:
> {code}
> define X `./home/xu/streamingscript/DataGuaranteeTest.pl -n 1`
> ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = group A by name;
> C = foreach B generate flatten(A);
> D = stream C through X;
> store D into 'results_24';
> {code}
> Here is the exception on the reduce task trackers:
> {noformat}
> java.lang.RuntimeException: java.io.IOException: Cannot run program
> "./home/xu/streamingscript/DataGuaranteeTest.pl": java.io.IOException:
> error=2, No such file or directory
> at
> org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
> at
> org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
> at
> org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
> at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
> at
> org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
> at
> org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
> {noformat}
> I will attach DataGuaranteeTest.pl to the report
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
