-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/47355/
-----------------------------------------------------------

Review request for Ambari, Jayush Luniya and Nate Cole.


Bugs: AMBARI-16664
    https://issues.apache.org/jira/browse/AMBARI-16664


Repository: ambari


Description
-------

Caused by AMBARI-14430.
When installing clusters on redhat7 family OSs, depending on the topology the 
installation could fail.

```
Traceback (most recent call last):
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py",
 line 67, in <module>
    MapReduce2Client().execute()
...
raise Fail("Applying %s failed, parent directory %s doesn't exist" % 
(self.resource, dirname))
resource_management.core.exceptions.Fail: Applying 
File['/usr/hdp/current/hadoop-yarn-client/bin/container-executor'] failed, 
parent directory /usr/hdp/current/hadoop-yarn-client/bin doesn't exist
```

This is because the specific package, in this case hadoop_2_5_0_0_453-mapreduce 
is not installed because it's not sent down to the agents as part of the 
packages structure.
This only affects some topologies since the affected components are installed 
by other components which have the correct OS families specified in their 
metainfo.xml files:

```
[root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires 
hadoop_2_5_0_0_453-mapreduce
hadoop_2_5_0_0_453-client-2.7.1.2.5.0.0-453.el6.x86_64
tez_2_5_0_0_453-0.7.0.2.5.0.0-453.el6.noarch
tez_hive2_2_5_0_0_453-0.8.4.2.5.0.0-453.el6.noarch
```

So, as long as Tez or Hadoop Client were installed on this box, then MapReduce 
would be there too.

Another example is ZooKeeper; since it's installed last, if any other packages 
are installed before it, the bits will be there:

```
[root@os-r7-fsqzxu-devdeployerie-3 data]# rpm -q --whatrequires 
zookeeper_2_5_0_0_453
hadoop_2_5_0_0_453-2.7.1.2.5.0.0-453.el6.x86_64
storm_2_5_0_0_453-1.0.1.2.5.0.0-453.el6.x86_64
hbase_2_5_0_0_453-1.1.2.2.5.0.0-453.el6.noarch
hive_2_5_0_0_453-1.2.1000.2.5.0.0-453.el6.noarch
hive2_2_5_0_0_453-2.1.0.2.5.0.0-453.el6.noarch
kafka_2_5_0_0_453-0.10.0.2.5.0.0-453.el6.noarch
```


Diffs
-----

  ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/metainfo.xml 
07080b4 
  ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/metainfo.xml 
cb08a9c 
  ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.6/metainfo.xml 
090e35d 
  ambari-server/src/main/resources/stacks/HDP/2.1/services/OOZIE/metainfo.xml 
7c4b232 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/metainfo.xml 
dacc1fb 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/PIG/metainfo.xml 
faf4c31 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/metainfo.xml 
629fe5f 

Diff: https://reviews.apache.org/r/47355/diff/


Testing
-------

Deployed ZK and MapR to CentOS7 on isolated hosts.


Thanks,

Jonathan Hurley

Reply via email to