Andrew Onischuk created AMBARI-11657:
----------------------------------------
Summary: Unable to install with non-root Agent
Key: AMBARI-11657
URL: https://issues.apache.org/jira/browse/AMBARI-11657
Project: Ambari
Issue Type: Bug
Reporter: Andrew Onischuk
Assignee: Andrew Onischuk
Fix For: 2.1.0
1) non-root ambari server and non-root ambari-agent, umask 027,
2) Build #1904
3) I attempt to install HDP 2.3 with hdfs, yarn, hive, zk, tez, atlas...fails
with error below on first component install
4) switch to agent as root (keeping everything else the same) and things work
fine
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py",
line 38, in <module>
BeforeInstallHook().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 216, in execute
method(env)
File
"/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py",
line 34, in hook
install_packages()
File
"/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py",
line 87, in install_packages
Package(packages)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
line 116, in __new__
cls(name.pop(0), env, provider, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
line 157, in __init__
self.env.run()
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 152, in run
self.run_action(resource, action)
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 118, in run_action
provider_action()
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py",
line 43, in action_install
self.install_package(package_name, self.resource.use_repos)
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 43, in install_package
if use_repos or not self._check_existence(name):
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 90, in _check_existence
package_list = yb.rpmdb.simplePkgList()
File "/usr/lib64/python2.6/contextlib.py", line 34, in __exit__
self.gen.throw(type, value, traceback)
File
"/usr/lib/python2.6/site-packages/resource_management/core/utils.py", line 117,
in suppress_stdout
yield
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py",
line 90, in _check_existence
package_list = yb.rpmdb.simplePkgList()
File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 502, in
simplePkgList
return self.pkglist
File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 232, in
_get_pkglist
csumpkgtups = self.preloadPackageChecksums(load_packages=False)
File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 979, in
preloadPackageChecksums
rpmdbv = self.simpleVersion(main_only=True)[0]
File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1125, in
simpleVersion
rpmdbv = self._get_cached_simpleVersion_main()
File "/usr/lib/python2.6/site-packages/yum/rpmsack.py", line 1075, in
_get_cached_simpleVersion_main
rpmdbv = open(rpmdbvfname).readline()[:-1]
IOError: [Errno 13] Permission denied: '//var/lib/yum/rpmdb-indexes/version'
stdout: /var/lib/ambari-agent/data/output-25.txt
2015-06-02 13:49:13,850 -
Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/'] {'recursive':
True}
2015-06-02 13:49:13,874 -
File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//jce_policy-8.zip']
{'content':
DownloadSource('http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip')}
2015-06-02 13:49:13,894 - Not downloading the file from
http://c6401.ambari.apache.org:8080/resources//jce_policy-8.zip, because
/var/lib/ambari-agent/data/tmp/jce_policy-8.zip already exists
2015-06-02 13:49:13,914 - Group['hadoopX'] {'ignore_failures': False}
2015-06-02 13:49:13,915 - Group['usersX'] {'ignore_failures': False}
2015-06-02 13:49:13,915 - User['ambari-qaX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['usersX']}
2015-06-02 13:49:13,916 - User['hcatX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,916 - User['yarnX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,917 - User['hiveX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,917 - User['atlasX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,918 - User['hdfsX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,919 - User['tezX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['usersX']}
2015-06-02 13:49:13,919 - User['zookeeperX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,919 - User['mapredX'] {'gid': 'hadoopX',
'ignore_failures': False, 'groups': ['hadoopX']}
2015-06-02 13:49:13,920 -
File['/var/lib/ambari-agent/data/tmp/changeUid.sh'] {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-06-02 13:49:13,983 -
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qaX
/tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX']
{'not_if': '(test $(id -u ambari-qaX) -gt 1000) || (false)'}
2015-06-02 13:49:13,988 - Skipping
Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qaX
/tmp/hadoop-ambari-qaX,/tmp/hsperfdata_ambari-qaX,/home/ambari-qaX,/tmp/ambari-qaX,/tmp/sqoop-ambari-qaX']
due to not_if
2015-06-02 13:49:13,988 - Group['hdfsX'] {'ignore_failures': False}
2015-06-02 13:49:13,988 - User['hdfsX'] {'ignore_failures': False,
'groups': ['hadoopX', 'hdfsX']}
2015-06-02 13:49:13,989 - Directory['/etc/hadoop'] {'mode': 0755}
2015-06-02 13:49:14,029 - Repository['HDP-2.3'] {'base_url':
'http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos6/2.x/BUILDS/2.3.0.0-2208',
'action': ['create'], 'components': ['HDP', 'main'], 'repo_template':
'repo_suse_rhel.j2', 'repo_file_name': 'HDP', 'mirror_list': None}
2015-06-02 13:49:14,037 - File['/etc/yum.repos.d/HDP.repo'] {'content':
Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')}
2015-06-02 13:49:14,085 - Repository['HDP-UTILS-1.1.0.20'] {'base_url':
'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos6',
'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template':
'repo_suse_rhel.j2', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2015-06-02 13:49:14,089 - File['/etc/yum.repos.d/HDP-UTILS.repo']
{'content':
Template('/usr/lib/ambari-server/lib/resource_management/libraries/providers/../data/repo_suse_rhel.j2')}
2015-06-02 13:49:14,133 - Package['unzip'] {}
2015-06-02 13:49:14,221 - Installing package unzip ('/usr/bin/yum -d 0 -e 0
-y install unzip')
2015-06-02 13:49:21,096 - Package['curl'] {}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
