[
https://issues.apache.org/jira/browse/HADOOP-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585877#action_12585877
]
Tsz Wo (Nicholas), SZE commented on HADOOP-3182:
------------------------------------------------
Below are some codes found in TaskTracker:
{code}
private void localizeJob(TaskInProgress tip) throws IOException {
...
FileStatus status[] = fileSystem.listStatus(new Path(jobFile).getParent());
...
for(FileStatus stat : status) {
if (stat.getPath().toString().contains("job.xml")) {
...
}
if (stat.getPath().toString().contains("job.jar")) {
...
}
}
...
}
{code}
Why it first gets all FileStatus and then does a linear search for the path
containing "job.xml" and "job.jar"? It seems to me that the paths can be
constructed directly from <job-dir>/job.xml and <job-dir>/job.jar
> JobClient creates submitJobDir with SYSTEM_DIR_PERMISSION ( rwx-wx-wx)
> ----------------------------------------------------------------------
>
> Key: HADOOP-3182
> URL: https://issues.apache.org/jira/browse/HADOOP-3182
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.2
> Reporter: lohit vijayarenu
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.16.3, 0.17.0
>
>
> JobClient creates submitJobDir with SYSTEM_DIR_PERMISSION ( rwx-wx-wx ) which
> causes problem while sharing a cluster.
> Consider the case where userA starts jobtracker/tasktrackers and userB
> submits a job to this cluster. When userB creates submitJobDir it is created
> with rwx-wx-wx which cannot be read by tasktracker started by userA
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
