Hey guys, I'm trying to figure out why my pig script crashes half way (after
2 or 3 mr's) The error is below. I took a dump of the plan and didn't see
anything suspicious except that the missing temp file wasn't part of the
plan any where. The hadoop UI did not report any kind of MR error.
Any help would be appreciated.
2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
ERROR 6017: Execution failed, while processing hdfs://
sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
hdfs://sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
2010-04-29 15:59:04,579 [main] ERROR org.apache.pig.tools.grunt.Grunt -
org.apache.pig.backend.executionengine.ExecException: ERROR 6017: Execution
failed, while processing hdfs://
sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp34714003,
hdfs://sf-hadoop-002.richrelevance.com:44445/tmp/temp-320448336/tmp927013752
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:181)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:265)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:777)
at org.apache.pig.PigServer.execute(PigServer.java:770)
at org.apache.pig.PigServer.access$100(PigServer.java:89)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:947)
at org.apache.pig.PigServer.executeBatch(PigServer.java:249)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:320)
