[ http://issues.apache.org/jira/browse/HADOOP-546?page=all ]
Sanjay Dahiya updated HADOOP-546:
---------------------------------
Summary: Task tracker doesnt generate job.xml in jobcache for some
tasks ( possibly for only rescheduled tasks) (was: Jobtracker doesnt generate
job.xml in jobcache for some tasks ( possibly for only rescheduled tasks))
Description:
For many of the rescheduled tasks task tracker doesn't generate job.xml causing
the task to fail. The exception appears in Job tracker logs and not in task
tracker's logs.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from task_0001_m_022869_3: java.io.FileNotFoundException:
.../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml
(No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at
org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at
org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
was:
For many of the rescheduled tasks job tracker doesn't generate job.xml the task
fails on job tracker itself and is rescheduled for another node and fails again
as the file is still not generated, causing the job to fail.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error
from task_0001_m_022869_3: java.io.FileNotFoundException:
.../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml
(No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at
org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at
org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at
org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at
org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at
org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at
org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at
org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at
org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
> Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly
> for only rescheduled tasks)
> ------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-546
> URL: http://issues.apache.org/jira/browse/HADOOP-546
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.6.2
> Reporter: Sanjay Dahiya
> Priority: Critical
>
> For many of the rescheduled tasks task tracker doesn't generate job.xml
> causing the task to fail. The exception appears in Job tracker logs and not
> in task tracker's logs.
> possibly related to Hadoop-543
> 2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error
> from task_0001_m_022869_3: java.io.FileNotFoundException:
> .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml
> (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
> at
> org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
> at
> org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
> at
> org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
> at
> org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
> at
> org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
> at
> org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
> at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
> at
> org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
> at
> org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
> at
> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
> at
> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
> at
> org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
