Juanjo Marron created AMBARI-23285: -------------------------------------- Summary: ${hdp.version} parameter in downloaded Service Client Configs Key: AMBARI-23285 URL: https://issues.apache.org/jira/browse/AMBARI-23285 Project: Ambari Issue Type: Improvement Components: ambari-client Affects Versions: 2.6.2, 2.7.0 Reporter: Juanjo Marron
When using Download Service Client Configs feature in Ambari APIs, some of the configuration files the ${hdp.version} parameter is not resolved. This token needs to be replaced by the right hdp version value in order to properly use some of the properties. A good example is: mapred-site.xml configuration file form MapReduce2 service where multiple property values downloaded maintain the parameter ${hdp.version} These are two of them: <property> <name>mapreduce.application.classpath</name> <value>$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${*hdp.version}.*jar:/etc/hadoop/conf/secure:/usr/hdp/current/ext/hadoop/*</value> </property> <property> <name>mapreduce.application.framework.path</name> <value>/hdp/apps/*${hdp.version}*/mapreduce/mapreduce.tar.gz#mr-framework</value> </property> Also I have seen tokens that get replaced in the UI but not in the configuration file downloaded, for example: The property yarn.nodemanager.aux-services.spark2_shuffle.classpath in advanced yarn-site.xml (YARN service) shows this value in the UI: {\{stack_root}}/${hdp.version}/spark2/aux/* While in the client configurations obtained after downloaded <property> <name>yarn.nodemanager.aux-services.spark2_shuffle.classpath</name> <value>/usr/hdp/${hdp.version}/spark2/aux/*</value> </property> {\{stack_root}} gets properly replaced but ${hdp.version} remains as a string not resolved According to the answers in the Ambari user mail list is expected for now. The problem is that client configs are run and rendered on the Ambari server itself, which might not even be a part of the cluster. Some properties, such as the ones showed above , are rendered on a per-host basis, and can be different depending on the versions of the components which are installed. We believe that the download client configs logic needs to be rewritten to allow you to specify the host on which you want to download them. -- This message was sent by Atlassian JIRA (v7.6.3#76005)