Doroszlai, Attila created AMBARI-21708:
------------------------------------------
Summary: History Server cannot be started due to wrong permissions
of /mr-history
Key: AMBARI-21708
URL: https://issues.apache.org/jira/browse/AMBARI-21708
Project: Ambari
Issue Type: Bug
Components: ambari-server
Affects Versions: 3.0.0
Reporter: Doroszlai, Attila
Assignee: Doroszlai, Attila
Priority: Critical
Fix For: 3.0.0
Steps to reproduce:
# Install Ambari from trunk
# Create cluster with MapReduce2
Result: History Server becomes stopped after starting it.
During startup History Server tries to create {{/mr-history/tmp}}, but fails:
{noformat:title=mapred-mapred-historyserver.log}
2017-08-09 11:54:20,957 INFO service.AbstractService
(AbstractService.java:noteFailure(272)) - Service
org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager failed in state INITED;
cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating
intermediate done directory
...
Caused by: org.apache.hadoop.security.AccessControlException: Permission
denied: user=mapred, access=WRITE, inode="/mr-history/tmp":hdfs:hdfs:drwxr-xr-x
...
2017-08-09 11:54:20,971 INFO util.ExitUtil (ExitUtil.java:terminate(124)) -
Exiting with status -1
{noformat}
Caused by wrong permissions on {{/mr-history}}:
{noformat:title=trunk}
drwxr-xr-x - hdfs hdfs 0 2017-08-09 11:54 /mr-history
drwxrwxrwx - mapred hadoop 0 2017-08-09 11:54 /mr-history/done
{noformat}
{noformat:title=branch-2.5}
drwxrwxrwx - mapred hadoop 0 2017-08-09 12:26 /mr-history
drwxrwxrwx - mapred hadoop 0 2017-08-09 12:26 /mr-history/done
drwxrwxrwt - mapred hadoop 0 2017-08-09 12:26 /mr-history/tmp
{noformat}
In AMBARI-21116 recursive permissions were eliminated for the wrong directory
in {{YARN/2.1.0.2.0}}: {{mapreduce_jobhistory_done_dir}} instead of
{{node_labels_dir}}.
Compare:
{noformat:title=YARN/2.1.0.2.0/package/scripts/yarn.py}
params.HdfsResource(params.mapreduce_jobhistory_done_dir,
type="directory",
action="create_on_execute",
owner=params.mapred_user,
group=params.user_group,
- change_permissions_for_parents=True,
mode=0777
)
{noformat}
with:
{noformat:title=YARN/3.0.0.3.0/package/scripts/yarn.py}
params.HdfsResource(params.node_labels_dir,
type="directory",
action="create_on_execute",
- change_permissions_for_parents=True,
owner=params.yarn_user,
group=params.user_group,
mode=0700
)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
