Pig crash when it cannot get counter from hadoop
------------------------------------------------
Key: PIG-943
URL: https://issues.apache.org/jira/browse/PIG-943
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.3.0
Reporter: Daniel Dai
Fix For: 0.4.0
We see following call stacks in Pig:
Case 1:
Caused by: java.lang.NullPointerException
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.computeWarningAggregate(MapReduceLauncher.java:390)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:238)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
Case 2:
Caused by: java.lang.NullPointerException
at
org.apache.pig.tools.pigstats.PigStats.accumulateMRStats(PigStats.java:150)
at
org.apache.pig.tools.pigstats.PigStats.accumulateStats(PigStats.java:91)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:192)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
In both cases, hadoop jobs finishes without error. The cause of both problems
is RunningJob.getCounters() returns a null, and Pig do not currently check for
that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
