Jonathan Hurley created AMBARI-16664:
----------------------------------------
Summary: Unable to Deploy Cluster on redhat7 Family OSs
Key: AMBARI-16664
URL: https://issues.apache.org/jira/browse/AMBARI-16664
Project: Ambari
Issue Type: Bug
Components: ambari-server
Affects Versions: 2.2.2
Environment: CentOS7 / Redhat7
Reporter: Jonathan Hurley
Assignee: Jonathan Hurley
Priority: Blocker
Fix For: 2.4.0
Caused by AMBARI-14430.
When installing clusters on {{redhat7}} family OSs, depending on the topology
the installation could fail.
{code}
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py",
line 67, in <module>
MapReduce2Client().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 254, in execute
method(env)
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py",
line 36, in install
self.configure(env)
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py",
line 41, in configure
yarn()
File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py",
line 89, in thunk
return fn(*args, **kwargs)
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/yarn.py",
line 351, in yarn
mode=params.container_executor_mode
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py",
line 155, in __init__
self.env.run()
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 160, in run
self.run_action(resource, action)
File
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py",
line 124, in run_action
provider_action()
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 120, in action_create
raise Fail("Applying %s failed, parent directory %s doesn't exist" %
(self.resource, dirname))
resource_management.core.exceptions.Fail: Applying
File['/usr/hdp/current/hadoop-yarn-client/bin/container-executor'] failed,
parent directory /usr/hdp/current/hadoop-yarn-client/bin doesn't exist
{code}
This is because the specific package, in this case
{{hadoop_2_5_0_0_453-mapreduce}} is not installed because it's not sent down to
the agents as part of the {{packages}} structure.
This only affects some topologies since the affected components are installed
by other components which have the correct OS families specified in their
{{metainfo.xml}} files:
[root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires
hadoop_2_5_0_0_453-mapreduce
hadoop_2_5_0_0_453-client-2.7.1.2.5.0.0-453.el6.x86_64
tez_2_5_0_0_453-0.7.0.2.5.0.0-453.el6.noarch
tez_hive2_2_5_0_0_453-0.8.4.2.5.0.0-453.el6.noarch
{code}
So, as long as Tez or Hadoop Client were installed on this box, then MapReduce
would be there too.
Another example is ZooKeeper; since it's installed last, if any other packages
are installed before it, the bits will be there:
{code}
[root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires
zookeeper_2_5_0_0_453
hadoop_2_5_0_0_453-2.7.1.2.5.0.0-453.el6.x86_64
storm_2_5_0_0_453-1.0.1.2.5.0.0-453.el6.x86_64
hbase_2_5_0_0_453-1.1.2.2.5.0.0-453.el6.noarch
hive_2_5_0_0_453-1.2.1000.2.5.0.0-453.el6.noarch
hive2_2_5_0_0_453-2.1.0.2.5.0.0-453.el6.noarch
kafka_2_5_0_0_453-0.10.0.2.5.0.0-453.el6.noarch
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)