-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64502/
-----------------------------------------------------------
Review request for Ambari, Dmitro Lisnichenko and Nate Cole.
Bugs: AMBARI-22628
https://issues.apache.org/jira/browse/AMBARI-22628
Repository: ambari
Description
-------
Downloaded client configs have invalid values for spark properties in
yarn-site.xml.
Issue: spark_version variable is replaced by 'None' in the spark related config
properties in yarn-site in the client configs downloaded.
Attaching downloaded yarn-site.xml
[^yarn-site.xml]
Properties with issue:
{code:java}
<property>
<name>yarn.nodemanager.aux-services.spark2_shuffle.classpath</name>
<value>/usr/hdp/None/spark2/aux/*</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.spark_shuffle.classpath</name>
<value>/usr/hdp/None/spark/aux/*</value>
</property>
<property>
<name>yarn.timeline-service.entity-group-fs-store.group-id-plugin-classpath</name>
<value>/usr/hdp/None/spark/hdpLib/*</value>
</property>
{code}
The cause for this is that YARN Clients on hosts without daemons never get a
restart command after the initial {{yarn-site.xml}}, and can never fill in the
correct values.
Diffs
-----
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
98141456c7
Diff: https://reviews.apache.org/r/64502/diff/1/
Testing
-------
Manual install via UI and Blueprint
Thanks,
Jonathan Hurley
