TaskTracker::localizeJob doesn't provide the correct size to LocalDirAllocator
------------------------------------------------------------------------------
Key: HADOOP-3203
URL: https://issues.apache.org/jira/browse/HADOOP-3203
Project: Hadoop Core
Issue Type: Bug
Affects Versions: 0.15.3
Reporter: Chris Douglas
Fix For: 0.18.0
In TaskTracker::localizeJob:
{code}
// Get sizes of JobFile and JarFile
// sizes are -1 if they are not present.
FileSystem fileSystem = FileSystem.get(fConf);
FileStatus status[] = fileSystem.listStatus(new Path(jobFile).getParent());
long jarFileSize = -1;
long jobFileSize = -1;
for(FileStatus stat : status) {
if (stat.getPath().toString().contains("job.xml")) {
jobFileSize = stat.getLen();
} else {
jobFileSize = -1;
}
if (stat.getPath().toString().contains("job.jar")) {
jarFileSize = stat.getLen();
} else {
jarFileSize = -1;
}
}
{code}
One or both of jobFileSize and jarFileSize will be -1.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
