[
https://issues.apache.org/jira/browse/AMBARI-14751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200260#comment-15200260
]
Nick Dimiduk commented on AMBARI-14751:
---------------------------------------
I'm happy to extract debugging information from my cluster, but this is
impacting my prod cluster, not staging, so i'm unwilling to experiment with it.
The current state is that this variable isn't substituted anywhere; I've gone
through all my service configs and replaced the variable with the explicit
value. I don't think it's isolated to a single service because it impacted
HBase, MR2, and non-MR YARN applications. Basically everything deployed on the
cluster.
> Ambari not setting hdp.version in config files
> ----------------------------------------------
>
> Key: AMBARI-14751
> URL: https://issues.apache.org/jira/browse/AMBARI-14751
> Project: Ambari
> Issue Type: Bug
> Affects Versions: 2.2.0
> Reporter: Nick Dimiduk
> Assignee: Dmitry Lysnichenko
> Priority: Critical
> Fix For: 2.2.2
>
>
> After dealing with a number of arcane failures, I've tracked down the issue
> to ambari not rendering config files correctly. This manifests mostly MR and
> Spark job submission failures. For example,
> {noformat}
> $ hbase org.apache.hadoop.hbase.mapreduce.RowCounter -libjars
> /usr/hdp/current/phoenix-client/phoenix-server.jar
> -Dhbase.client.scanner.caching=1000 -Dmapreduce.map.speculative=false TEST
> ...
> Exception in thread "main" java.lang.IllegalArgumentException: Unable to
> parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a
> URI, check the setting for mapreduce.application.framework.path
> at
> org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:443)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
> at
> org.apache.hadoop.hbase.mapreduce.RowCounter.main(RowCounter.java:210)
> Caused by: java.net.URISyntaxException: Illegal character in path at index
> 11: /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework
> at java.net.URI$Parser.fail(URI.java:2848)
> at java.net.URI$Parser.checkChars(URI.java:3021)
> at java.net.URI$Parser.parseHierarchical(URI.java:3105)
> at java.net.URI$Parser.parse(URI.java:3063)
> at java.net.URI.<init>(URI.java:588)
> at
> org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:441)
> ... 9 more
> {noformat}
> Restarting ambari-server + redeploying configs does not help.
> {noformat}
> $ dpkg -s ambari-server
> Package: ambari-server
> Status: install ok installed
> Priority: extra
> Section: universe/admin
> Installed-Size: 457149
> Maintainer: Hortonworks
> Architecture: amd64
> Version: 2.2.0.0-1310
> Depends: openssl, postgresql (>= 8.1), python (>= 2.6), curl
> Description: Ambari Server
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
