Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for
only rescheduled tasks)
----------------------------------------------------------------------------------------------------
Key: HADOOP-546
URL: http://issues.apache.org/jira/browse/HADOOP-546
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.6.2
Reporter: Sanjay Dahiya
Priority: Critical
For many of the rescheduled tasks job tracker doesn't generate job.xml the task
fails on job tracker itself and is rescheduled for another node and fails again
as the file is still not generated, causing the job to fail.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from task_0001_m_022869_3: java.io.FileNotFoundException:
.../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml
(No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at
org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at
org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
