Andrew Onischuk created AMBARI-12191:
----------------------------------------
Summary: RU: zk upgrade fails with non-root agent + umask 027
Key: AMBARI-12191
URL: https://issues.apache.org/jira/browse/AMBARI-12191
Project: Ambari
Issue Type: Bug
Reporter: Andrew Onischuk
Assignee: Andrew Onischuk
Fix For: 2.1.0
Attempting RU with non-root ambari server + umask 027 + non-root agent. Fails
when trying to restart first ZooKeeper.
If I stop my agent, and start it as root, and then click "retry" in the RU
dialog, it can make it thru the ZooKeeper restart.
Below are the errors when attempting as non-root agent, as well as my agent
user visudo setup. Are Ambari commands that need to be added and/or things
aren't running thru sudo like they should...or maybe it has to do with
something + umask 027?
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py",
line 176, in <module>
ZookeeperServer().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 216, in execute
method(env)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 441, in restart
self.pre_rolling_restart(env)
File
"/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py",
line 79, in pre_rolling_restart
hdp_select.select("zookeeper-server", params.version)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/hdp_select.py",
line 107, in select
Execute(command)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
line 157, in __init__
self.env.run()
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 152, in run
self.run_action(resource, action)
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 118, in run_action
provider_action()
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 254, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70,
in inner
result = function(command, **kwargs)
File
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92,
in checked_call
tries=tries, try_sleep=try_sleep)
File
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140,
in _call_wrapper
result = _call(command, **kwargs_copy)
File
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291,
in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'hdp-select set
zookeeper-server 2.3.0.0-2474' returned 1. Traceback (most recent call last):
File "/usr/bin/hdp-select", line 373, in <module>
setPackages(pkgs, args[2], options.rpm_mode)
File "/usr/bin/hdp-select", line 265, in setPackages
os.remove(linkname)
OSError: [Errno 13] Permission denied: '/usr/hdp/current/zookeeper-server'
2015-06-26 00:04:56,968 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:56,996 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:57,021 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:57,046 - call['conf-select set-conf-dir --package hadoop
--stack-version 2.3.0.0-2474 --conf-version 0'] {'logoutput': False, 'quiet':
False}
2015-06-26 00:04:57,073 - call returned (1, '/etc/hadoop/2.3.0.0-2474/0does
not exist')
2015-06-26 00:04:57,096 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:57,282 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:57,305 - call['conf-select set-conf-dir --package hadoop
--stack-version 2.3.0.0-2474 --conf-version 0'] {'logoutput': False, 'quiet':
False}
2015-06-26 00:04:57,326 - call returned (1, '/etc/hadoop/2.3.0.0-2474/0does
not exist')
2015-06-26 00:04:57,349 - zookeeper-server is currently at version
2.2.6.0-2800
2015-06-26 00:04:57,352 -
Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/'] {'recursive':
True}
2015-06-26 00:04:57,384 -
File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']
{'content':
DownloadSource('http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip')}
2015-06-26 00:04:57,412 - Not downloading the file from
http://c6401.ambari.apache.org:8080/resources//UnlimitedJCEPolicyJDK7.zip,
because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already exists
2015-06-26 00:04:57,436 - Group['jusers'] {'ignore_failures': False}
2015-06-26 00:04:57,439 - Group['jhadoop'] {'ignore_failures': False}
2015-06-26 00:04:57,439 - User['jams'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,440 - User['jhbase'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,440 - User['jyarn'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,442 - User['jhdfs'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,442 - User['jambari-qa'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jusers']}
2015-06-26 00:04:57,442 - User['jzookeeper'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,443 - User['jhive'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,444 - User['jtez'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jusers']}
2015-06-26 00:04:57,444 - User['jhcat'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,444 - User['jmapred'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,446 - User['jkafka'] {'gid': 'jhadoop',
'ignore_failures': False, 'groups': ['jhadoop']}
2015-06-26 00:04:57,447 -
File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-06-26 00:04:57,527 -
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh jambari-qa
/tmp/hadoop-jambari-qa,/tmp/hsperfdata_jambari-qa,/home/jambari-qa,/tmp/jambari-qa,/tmp/sqoop-jambari-qa']
{'not_if': '(test $(id -u jambari-qa) -gt 1000) || (false)'}
2015-06-26 00:04:57,535 - Skipping
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh jambari-qa
/tmp/hadoop-jambari-qa,/tmp/hsperfdata_jambari-qa,/home/jambari-qa,/tmp/jambari-qa,/tmp/sqoop-jambari-qa']
due to not_if
2015-06-26 00:04:57,536 - Directory['/tmp/hbase-hbase'] {'owner': 'jhbase',
'recursive': True, 'mode': 0775, 'cd_access': 'a'}
2015-06-26 00:04:57,627 -
File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-06-26 00:04:57,708 -
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh jhbase
/home/jhbase,/tmp/jhbase,/usr/bin/jhbase,/var/log/jhbase,/tmp/hbase-hbase']
{'not_if': '(test $(id -u jhbase) -gt 1000) || (false)'}
2015-06-26 00:04:57,715 - Skipping
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh jhbase
/home/jhbase,/tmp/jhbase,/usr/bin/jhbase,/var/log/jhbase,/tmp/hbase-hbase'] due
to not_if
2015-06-26 00:04:57,716 - Group['jhdfs'] {'ignore_failures': False}
2015-06-26 00:04:57,716 - User['jhdfs'] {'ignore_failures': False,
'groups': ['jhadoop', 'jhdfs']}
2015-06-26 00:04:57,717 - Directory['/etc/hadoop'] {'mode': 0755}
2015-06-26 00:04:57,783 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/hadoop-env.sh'] {'content':
InlineTemplate(...), 'owner': 'jhdfs', 'group': 'jhadoop'}
2015-06-26 00:04:57,843 - Writing
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/hadoop-env.sh'] because contents don't
match
2015-06-26 00:04:57,892 - Execute['('setenforce', '0')'] {'not_if': '(!
which getenforce ) || (which getenforce && getenforce | grep -q Disabled)',
'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2015-06-26 00:04:57,904 - Skipping Execute['('setenforce', '0')'] due to
not_if
2015-06-26 00:04:57,905 - Directory['/var/log/hadoop'] {'owner': 'root',
'mode': 0775, 'group': 'jhadoop', 'recursive': True, 'cd_access': 'a'}
2015-06-26 00:04:58,034 - Directory['/var/run/hadoop'] {'owner': 'root',
'group': 'root', 'recursive': True, 'cd_access': 'a'}
2015-06-26 00:04:58,136 - Directory['/tmp/hadoop-jhdfs'] {'owner': 'jhdfs',
'recursive': True, 'cd_access': 'a'}
2015-06-26 00:04:58,256 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/commons-logging.properties']
{'content': Template('commons-logging.properties.j2'), 'owner': 'jhdfs'}
2015-06-26 00:04:58,318 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/health_check'] {'content':
Template('health_check.j2'), 'owner': 'jhdfs'}
2015-06-26 00:04:58,383 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/log4j.properties'] {'content': '...',
'owner': 'jhdfs', 'group': 'jhadoop', 'mode': 0644}
2015-06-26 00:04:58,467 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/hadoop-metrics2.properties']
{'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'jhdfs'}
2015-06-26 00:04:58,535 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/task-log4j.properties'] {'content':
StaticFile('task-log4j.properties'), 'mode': 0755}
2015-06-26 00:04:58,618 -
File['/usr/hdp/2.3.0.0-2474/hadoop/conf/configuration.xsl'] {'owner': 'jhdfs',
'group': 'jhadoop'}
2015-06-26 00:04:58,930 - Execute['source
/usr/hdp/current/zookeeper-server/conf/zookeeper-env.sh ; env
ZOOCFGDIR=/usr/hdp/current/zookeeper-server/conf ZOOCFG=zoo.cfg
/usr/hdp/current/zookeeper-server/bin/zkServer.sh stop'] {'user': 'jzookeeper'}
2015-06-26 00:04:59,015 - Execute['rm -f
/var/run/zookeeper/zookeeper_server.pid'] {}
2015-06-26 00:04:59,028 - Executing Rolling Upgrade pre-restart
2015-06-26 00:04:59,061 - call['conf-select set-conf-dir --package
zookeeper --stack-version 2.3.0.0-2474 --conf-version 0'] {'logoutput': False,
'quiet': False}
2015-06-26 00:04:59,093 - call returned (1,
'/etc/zookeeper/2.3.0.0-2474/0does not exist')
2015-06-26 00:04:59,093 - Execute['hdp-select set zookeeper-server
2.3.0.0-2474'] {}
Defaults exempt_group = ambari
Defaults !env_reset,env_delete-=PATH
Defaults: ambari !requiretty
# Ambari Customizable Users
ambari ALL=(ALL) NOPASSWD:SETENV: /bin/su jhdfs *, /bin/su jzookeeper *,
/bin/su jknox *,/bin/su jfalcon *,/bin/su jflume *,/bin/su jhbase *,/bin/su
jhive *, /bin/su jhcat *,/bin/su jkafka *,/bin/su jmapred *,/bin/su joozie
*,/bin/su jsqoop *,/bin/su jstorm *,/bin/su jtez *,/bin/su jyarn *,/bin/su jams
*, /bin/su jambari-qa *, /bin/su jspark *, /bin/su jranger *
# Ambari Non-Customizable Users
ambari ALL=(ALL) NOPASSWD:SETENV: /bin/su mysql *
# Ambari Commands
ambari ALL=(ALL) NOPASSWD:SETENV:
/usr/bin/yum,/usr/bin/zypper,/usr/bin/apt-get, /bin/mkdir, /bin/ln,/bin/chown,
/bin/chmod, /bin/chgrp, /usr/sbin/groupadd,
/usr/sbin/groupmod,/usr/sbin/useradd, /usr/sbin/usermod, /bin/cp, /bin/sed,
/bin/mv, /bin/rm, /bin/kill,/usr/bin/unzip, /bin/tar, /usr/bin/hdp-select,
/usr/hdp/current/hadoop-client/sbin/hadoop-daemon.sh,/usr/lib/hadoop/bin/hadoop-daemon.sh,
/usr/lib/hadoop/sbin/hadoop-daemon.sh, /usr/sbin/service mysql *,/sbin/service
mysqld *, /sbin/service mysql *, /sbin/chkconfig gmond off,/sbin/chkconfig
gmetad off, /etc/init.d/httpd *, /sbin/service hdp-gmetad start, /sbin/service
hdp-gmond start, /usr/bin/tee, /usr/sbin/gmond, /usr/sbin/update-rc.d
ganglia-monitor *, /usr/sbin/update-rc.d gmetad *, /etc/init.d/apache2 *,
/usr/sbin/service hdp-gmond *, /usr/sbin/service hdpgmetad *, /usr/bin/test,
/bin/touch, /usr/bin/stat, /usr/sbin/setenforce,
/usr/hdp/current/ranger-admin/setup.sh,
/usr/hdp/current/ranger-usersync/setup.sh, /usr/bin/ranger-usersync-start,
/usr/bin/ranger-usersync-stop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
