HDP 3 don’t have any more spark (1.x), only spark2. In general, old blueprints are not fully compatible and have to be tweaked a bit.
I see two options from where you are: 1) Upgrade your current blueprint, i.e. use it with HDP 2.6+, run the upgrade wizard from Ambari 2.7 to HDP 3, and export a new version of the blueprint. 2) Manually update the blueprint and remove the spark-defaults section it has. This is still not giving you the guarantee the blueprint will work, you might need to do more customisation. Benoit > On 25 Jul 2018, at 00:05, Lian Jiang <jiangok2...@gmail.com> wrote: > > Thanks Benoit for the advice. > > I switched to ambari 2.7. However, when I create the cluster, it failed due > to "config types are not defined in the stack: [spark-defaults]". > > Below links point to a spec < ambari2.7. > https://cwiki.apache.org/confluence/display/AMBARI/Blueprints#Blueprints-BlueprintStructure > > <https://cwiki.apache.org/confluence/display/AMBARI/Blueprints#Blueprints-BlueprintStructure> > https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.0.0/administering-ambari/content/amb_using_ambari_blueprints.html > > <https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.0.0/administering-ambari/content/amb_using_ambari_blueprints.html> > > https://github.com/apache/ambari/tree/release-2.7.0/ambari-server/src/main/resources/stacks/HDP > > <https://github.com/apache/ambari/tree/release-2.7.0/ambari-server/src/main/resources/stacks/HDP> > does not have HDP3.0. This makes it hard to troubleshoot. > > Do you know where I can find the source code of HDP3.0 ambari stack so that I > can check what configs are supported in new ambari? > > Thanks. > > > > On Mon, Jul 23, 2018 at 2:35 PM, Benoit Perroud <ben...@noisette.ch > <mailto:ben...@noisette.ch>> wrote: > Are you using Ambari 2.7? > > Make sure you upgrade Ambari to 2.7 first, since this version is required for > HDP 3 > > Benoit > > >> On 23 Jul 2018, at 23:32, Lian Jiang <jiangok2...@gmail.com >> <mailto:jiangok2...@gmail.com>> wrote: >> >> Hi, >> >> I am using ambari blueprint to install HDP 3.0 and cannot register the vdf >> file. >> >> The vdf file is (the url works): >> >> { >> "VersionDefinition": { >> "version_url": >> "http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml >> >> <http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.0.0.0/HDP-3.0.0.0-1634.xml>" >> } >> } >> >> The error is "An internal system exception occurred: Stack data, Stack HDP >> 3.0 is not found in Ambari metainfo" >> >> Any idea? Thanks. > >
signature.asc
Description: Message signed with OpenPGP using GPGMail
