[
https://issues.apache.org/jira/browse/PIG-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xu Zhang updated PIG-186:
-------------------------
Description:
Pig stoped at progress 56%. It seemed there had been exceptions on the the
reduce task trackers (see below). But waiting for 20 reduce tasks to time out
themselves is excruciating and blocking my other tests.
Here is my Pig script:
{code}
define X `DataGuaranteeTest.pl -n 1`
ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
B = group A by name;
C = foreach B generate flatten(A);
D = stream C through X;
store D into 'results_24';
{code}
Here is the exception on the reduce task trackers:
{noformat}
java.lang.RuntimeException: java.io.IOException: Cannot run program
"./home/xu/streamingscript/DataGuaranteeTest.pl": java.io.IOException: error=2,
No such file or directory
at
org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
at
org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
at
org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
at
org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
at
org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
{noformat}
I will attach DataGuaranteeTest.pl to the report
was:
Pig stoped at progress 56%. It seemed there had been exceptions on the the
reduce task trackers (see below). But waiting for 20 reduce tasks to time out
themselves is excruciating and blocking my other tests.
Here is my Pig script:
{code}
define X `./home/xu/streamingscript/DataGuaranteeTest.pl -n 1`
ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
B = group A by name;
C = foreach B generate flatten(A);
D = stream C through X;
store D into 'results_24';
{code}
Here is the exception on the reduce task trackers:
{noformat}
java.lang.RuntimeException: java.io.IOException: Cannot run program
"./home/xu/streamingscript/DataGuaranteeTest.pl": java.io.IOException: error=2,
No such file or directory
at
org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
at
org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
at
org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
at
org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
at
org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
{noformat}
I will attach DataGuaranteeTest.pl to the report
The second form of command is exactly what I used. I just updated the
description of the bug. Sorry for the confusion.
> Pig appears to hang with this Pig script
> ----------------------------------------
>
> Key: PIG-186
> URL: https://issues.apache.org/jira/browse/PIG-186
> Project: Pig
> Issue Type: Bug
> Reporter: Xu Zhang
> Assignee: Arun C Murthy
> Priority: Critical
> Attachments: DataGuaranteeTest.pl
>
>
> Pig stoped at progress 56%. It seemed there had been exceptions on the the
> reduce task trackers (see below). But waiting for 20 reduce tasks to time
> out themselves is excruciating and blocking my other tests.
> Here is my Pig script:
> {code}
> define X `DataGuaranteeTest.pl -n 1`
> ship('/home/xu/streamingscript/DataGuaranteeTest.pl');
> A = load '/user/pig/tests/data/singlefile/studenttab10k' as (name, age, gpa);
> B = group A by name;
> C = foreach B generate flatten(A);
> D = stream C through X;
> store D into 'results_24';
> {code}
> Here is the exception on the reduce task trackers:
> {noformat}
> java.lang.RuntimeException: java.io.IOException: Cannot run program
> "./home/xu/streamingscript/DataGuaranteeTest.pl": java.io.IOException:
> error=2, No such file or directory
> at
> org.apache.pig.impl.eval.StreamSpec$StreamDataCollector.(StreamSpec.java:132)
> at
> org.apache.pig.impl.eval.StreamSpec.setupDefaultPipe(StreamSpec.java:91)
> at
> org.apache.pig.impl.eval.CompositeEvalSpec.setupDefaultPipe(CompositeEvalSpec.java:51)
> at org.apache.pig.impl.eval.EvalSpec.setupPipe(EvalSpec.java:123)
> at
> org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.setupReducePipe(PigMapReduce.java:303)
> at
> org.apache.pig.backend.hadoop.executionengine.mapreduceExec.PigMapReduce.reduce(PigMapReduce.java:140)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:333)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2071)
> {noformat}
> I will attach DataGuaranteeTest.pl to the report
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
