[
https://issues.apache.org/jira/browse/HADOOP-3182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12586952#action_12586952
]
Tsz Wo (Nicholas), SZE commented on HADOOP-3182:
------------------------------------------------
*Where should <job-history-dir> be?* Found some codes in
org.apache.hadoop.mapred.JobHistory.JobInfo:
{code}
public static void logSubmitted(String jobId, JobConf jobConf,
String jobConfPath, long submitTime) {
...
// find user log directory
Path outputPath = FileOutputFormat.getOutputPath(jobConf);
userLogDir = jobConf.get("hadoop.job.history.user.location",
outputPath == null ? null : outputPath.toString());
if ("none".equals(userLogDir)) {
userLogDir = null;
}
if (userLogDir != null) {
userLogDir = userLogDir + "/_logs/history";
}
...
}
{code}
What is the usage of the jobconf property "hadoop.job.history.user.location"?
Cannot find any other codes using it or any description.about it.
> JobClient creates submitJobDir with SYSTEM_DIR_PERMISSION ( rwx-wx-wx)
> ----------------------------------------------------------------------
>
> Key: HADOOP-3182
> URL: https://issues.apache.org/jira/browse/HADOOP-3182
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.16.2
> Reporter: lohit vijayarenu
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.16.3, 0.17.0
>
>
> JobClient creates submitJobDir with SYSTEM_DIR_PERMISSION ( rwx-wx-wx ) which
> causes problem while sharing a cluster.
> Consider the case where userA starts jobtracker/tasktrackers and userB
> submits a job to this cluster. When userB creates submitJobDir it is created
> with rwx-wx-wx which cannot be read by tasktracker started by userA
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
