-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/61792/
-----------------------------------------------------------
Review request for Ambari, Nate Cole and Robert Levas.
Bugs: AMBARI-21770
https://issues.apache.org/jira/browse/AMBARI-21770
Repository: ambari
Description
-------
You can read the description at
https://issues.apache.org/jira/browse/AMBARI-21770 for more detail. Long story
short is that the `spark_shuffle` and `spark2_shuffle` properties are
difference in BigInsights. Where a default install of Spark1 in BI 4.2.0
doesn't even add `spark_shuffle`, the Spark2 install in BI 4.2.5 adds it
instead of `spark2_shuffle`.
There was a Jira (https://issues.apache.org/jira/browse/AMBARI-21421) which
removed `spark_shuffle` via a find replace so that HDP's `spark2_shuffle` would
take over. But this led to problems after adding spark post-upgrade.
The cleanest solution seemed to be to just reset the properties to the expected
defaults if Spark was installed. I used the spark-env/content key to determine
if Spark was installed.
Diffs
-----
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/upgrades/config-upgrade.xml
f55f9fb1a9
ambari-server/src/main/resources/stacks/BigInsights/4.2/upgrades/config-upgrade.xml
ad20bf9d94
Diff: https://reviews.apache.org/r/61792/diff/1/
Testing
-------
IOP 4.2 to HDP 2.6 upgrade
Thanks,
Jonathan Hurley
