[jira] [Commented] (AMBARI-21708) History Server cannot be started due to wrong permissions of /mr-history

2017-08-14 Thread Hudson (JIRA) 

[ 
https://issues.apache.org/jira/browse/AMBARI-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125351#comment-16125351
 ] 

Hudson commented on AMBARI-21708:
-

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #7884 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/7884/])
AMBARI-21708. History Server cannot be started due to wrong permissions 
(adoroszlai: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=4e3f7ebe06b146c5e676e3a81f1f159f26e74252])
* (edit) ambari-server/src/test/python/stacks/2.0.6/YARN/test_historyserver.py
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py


> History Server cannot be started due to wrong permissions of /mr-history
> 
>
> Key: AMBARI-21708
> URL: https://issues.apache.org/jira/browse/AMBARI-21708
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 3.0.0
>Reporter: Doroszlai, Attila
>Assignee: Doroszlai, Attila
>Priority: Critical
> Fix For: 3.0.0
>
> Attachments: AMBARI-21708.patch
>
>
> Steps to reproduce:
> # Install Ambari from trunk
> # Create cluster with MapReduce2
> Result: History Server becomes stopped after starting it.
> During startup History Server tries to create {{/mr-history/tmp}}, but fails:
> {noformat:title=mapred-mapred-historyserver.log}
> 2017-08-09 11:54:20,957 INFO  service.AbstractService 
> (AbstractService.java:noteFailure(272)) - Service 
> org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager failed in state INITED; 
> cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating 
> intermediate done directory
> ...
> Caused by: org.apache.hadoop.security.AccessControlException: Permission 
> denied: user=mapred, access=WRITE, 
> inode="/mr-history/tmp":hdfs:hdfs:drwxr-xr-x
> ...
> 2017-08-09 11:54:20,971 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - 
> Exiting with status -1
> {noformat}
> Caused by wrong permissions on {{/mr-history}}:
> {noformat:title=trunk}
> drwxr-xr-x   - hdfs   hdfs0 2017-08-09 11:54 /mr-history
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 11:54 /mr-history/done
> {noformat}
> {noformat:title=branch-2.5}
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 12:26 /mr-history
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 12:26 /mr-history/done
> drwxrwxrwt   - mapred hadoop  0 2017-08-09 12:26 /mr-history/tmp
> {noformat}
> In AMBARI-21116 recursive permissions were eliminated for the wrong directory 
> in {{YARN/2.1.0.2.0}}: {{mapreduce_jobhistory_done_dir}} instead of 
> {{node_labels_dir}}.
> Compare:
> {noformat:title=YARN/2.1.0.2.0/package/scripts/yarn.py}
>params.HdfsResource(params.mapreduce_jobhistory_done_dir,
> type="directory",
>  action="create_on_execute",
>  owner=params.mapred_user,
>  group=params.user_group,
>  -   change_permissions_for_parents=True,
>  mode=0777
> )
> {noformat}
> with:
> {noformat:title=YARN/3.0.0.3.0/package/scripts/yarn.py}
>  params.HdfsResource(params.node_labels_dir,
>type="directory",
>action="create_on_execute",
>  - change_permissions_for_parents=True,
>owner=params.yarn_user,
>group=params.user_group,
>mode=0700
>  )
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (AMBARI-21708) History Server cannot be started due to wrong permissions of /mr-history

2017-08-11 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/AMBARI-21708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124049#comment-16124049
 ] 

Hadoop QA commented on AMBARI-21708:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12881429/AMBARI-21708.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:red}-1 core tests{color}.  The test build failed in 
[ambari-server|https://builds.apache.org/job/Ambari-trunk-test-patch/11985//artifact/patch-work/testrun_ambari-server.txt]
 

Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/11985//console

This message is automatically generated.

> History Server cannot be started due to wrong permissions of /mr-history
> 
>
> Key: AMBARI-21708
> URL: https://issues.apache.org/jira/browse/AMBARI-21708
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 3.0.0
>Reporter: Doroszlai, Attila
>Assignee: Doroszlai, Attila
>Priority: Critical
> Fix For: 3.0.0
>
> Attachments: AMBARI-21708.patch
>
>
> Steps to reproduce:
> # Install Ambari from trunk
> # Create cluster with MapReduce2
> Result: History Server becomes stopped after starting it.
> During startup History Server tries to create {{/mr-history/tmp}}, but fails:
> {noformat:title=mapred-mapred-historyserver.log}
> 2017-08-09 11:54:20,957 INFO  service.AbstractService 
> (AbstractService.java:noteFailure(272)) - Service 
> org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager failed in state INITED; 
> cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating 
> intermediate done directory
> ...
> Caused by: org.apache.hadoop.security.AccessControlException: Permission 
> denied: user=mapred, access=WRITE, 
> inode="/mr-history/tmp":hdfs:hdfs:drwxr-xr-x
> ...
> 2017-08-09 11:54:20,971 INFO  util.ExitUtil (ExitUtil.java:terminate(124)) - 
> Exiting with status -1
> {noformat}
> Caused by wrong permissions on {{/mr-history}}:
> {noformat:title=trunk}
> drwxr-xr-x   - hdfs   hdfs0 2017-08-09 11:54 /mr-history
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 11:54 /mr-history/done
> {noformat}
> {noformat:title=branch-2.5}
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 12:26 /mr-history
> drwxrwxrwx   - mapred hadoop  0 2017-08-09 12:26 /mr-history/done
> drwxrwxrwt   - mapred hadoop  0 2017-08-09 12:26 /mr-history/tmp
> {noformat}
> In AMBARI-21116 recursive permissions were eliminated for the wrong directory 
> in {{YARN/2.1.0.2.0}}: {{mapreduce_jobhistory_done_dir}} instead of 
> {{node_labels_dir}}.
> Compare:
> {noformat:title=YARN/2.1.0.2.0/package/scripts/yarn.py}
>params.HdfsResource(params.mapreduce_jobhistory_done_dir,
> type="directory",
>  action="create_on_execute",
>  owner=params.mapred_user,
>  group=params.user_group,
>  -   change_permissions_for_parents=True,
>  mode=0777
> )
> {noformat}
> with:
> {noformat:title=YARN/3.0.0.3.0/package/scripts/yarn.py}
>  params.HdfsResource(params.node_labels_dir,
>type="directory",
>action="create_on_execute",
>  - change_permissions_for_parents=True,
>owner=params.yarn_user,
>group=params.user_group,
>mode=0700
>  )
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)