[
https://issues.apache.org/jira/browse/HADOOP-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12669844#action_12669844
]
Tsz Wo (Nicholas), SZE commented on HADOOP-5146:
------------------------------------------------
There is a DiskErrorException (and so the job failed) when we run the sample
programs such as PiEstimator.
{noformat}
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
taskTracker/pids/attempt_200902021632_0001_m_000002_0 in any of the configured
local directories
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:381)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
at
org.apache.hadoop.mapred.TaskTracker.getPidFilePath(TaskTracker.java:430)
at
org.apache.hadoop.mapred.TaskTracker.removePidFile(TaskTracker.java:440)
at
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.runChild(JvmManager.java:370)
at
org.apache.hadoop.mapred.JvmManager$JvmManagerForType$JvmRunner.run(JvmManager.java:338)
{noformat}
(I have changed TaskTracker line 432 to print out the trace.)
> LocalDirAllocator misses files on the local filesystem
> ------------------------------------------------------
>
> Key: HADOOP-5146
> URL: https://issues.apache.org/jira/browse/HADOOP-5146
> Project: Hadoop Core
> Issue Type: Bug
> Affects Versions: 0.20.0
> Reporter: Arun C Murthy
> Assignee: Devaraj Das
> Priority: Blocker
> Fix For: 0.20.0
>
> Attachments: localdirallocator.patch, localdirallocator.patch
>
>
> For some reason the LocalDirAllocator.getLocaPathToRead doesn't find files
> which are present, extra logging shows:
> {noformat}
> 2009-01-30 06:43:32,312 INFO
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in ifExists,
> /grid/2/arunc/mapred-local/taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst
> exists
> 2009-01-30 06:43:32,389 WARN
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in
> getLocalPathToRead, taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst
> doesn't exist
> 2009-01-30 06:43:32,390 WARN org.apache.hadoop.mapred.TaskRunner:
> attempt_200901300512_0007_m_000055_0 Child Error
> org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find
> taskTracker/archive/xx.yyy.com/tera/in/_partition.lst in any of the
> configured local directories
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:388)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
> at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:172)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
