[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Attachment: jobxml.patch
this patch fixes the problem. The problem arose on a half execution of
localizejob. this might happen when the namenode is very busy. The job.xml is
copied but the job.jar isnt. So the job is not fully localized. The new task on
the machine tries to localize the job but fails with the error mentioned. This
patch deletes any presexisting job.xml if the job has not been fully localized
and tries localizing the job again.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to
> fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error
> from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target
> /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at
> org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at
> org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at
> org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
