map tasks fail because they do not find application in file cache
-----------------------------------------------------------------
Key: HADOOP-1234
URL: https://issues.apache.org/jira/browse/HADOOP-1234
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.12.1
Reporter: Christian Kunz
Using C++ map-reduce interface, a lot of tasks fail because they do not find
the application in the file cache.
Might be a race condition between multiple tasks on the same node.
java.io.IOException: Cannot run program
"<path>/mapred/local/taskTracker/archive/<namenodehost>/<path>/<application>":
java.io.IOException: error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
at
org.apache.hadoop.mapred.pipes.Application.runClient(Application.java:131)
at org.apache.hadoop.mapred.pipes.Application.(Application.java:59)
at
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:44)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:176)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1459)
Caused by: java.io.IOException: java.io.IOException: error=2, No such file or
directory
at java.lang.UNIXProcess.(UNIXProcess.java:148)
at java.lang.ProcessImpl.start(ProcessImpl.java:65)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
... 5 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
