Hi,
I am trying to submit a job to hadoop in non-interactive (i.e. I just
want to submit the job and do not want to see the progress) mode. I
tried doing this; the job gets submitted but all the map tasks fail with
the following exception:
Error initializing task_0001_m_000011_0:
java.io.IOException:
/tmp/hadoop-nemahajan/mapred/system/submit_wdta1y/job.xml: No such file
or directory
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:113)
at
org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.jav
a:55)
at
org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:780)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:539)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1087)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:752)
at
org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1123)
at
org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1853)
I have overridden JobClient#runJob() to achive this mode. I just do a
jc.submitJob() (similar to JobClient#runJob()), but I do not wait for
the status report. I just return. My guess is, the job is not getting
fully submitted, so the job xml is not getting created. Any thoughts on
what needs to be done.
Thanks,
Neeraj
