Alejandro Fernandez created AMBARI-12057:
--------------------------------------------

             Summary: RU - MR service check failed with unknown host exception 
because HistoryServer died since hdfs-site.xml is missing
                 Key: AMBARI-12057
                 URL: https://issues.apache.org/jira/browse/AMBARI-12057
             Project: Ambari
          Issue Type: Bug
          Components: ambari-server
    Affects Versions: 2.1.0
            Reporter: Alejandro Fernandez
            Assignee: Alejandro Fernandez
            Priority: Blocker
             Fix For: 2.1.0


STR:
* Installed Ambari 2.1.0 at build 2216
* Deployed HDP 2.2.7 with HDFS, YARN, MR, Pig, Tez, Oozie, ZK, and the host 
containing HistoryServer only also having DataNode, and NodeManager.
* Enabled NameNode and ResourceManager HA
* Installed repo for HDP 2.3
* Performed an RU

The MR and Oozie Service Checks failed because HistorySever died immediately 
after being started because hdfs-site.xml was missing from 
/etc/hadoop/2.3.0.0-2425/0/

{code}
resource_management.core.exceptions.Fail: Execution of 'hadoop --config 
/usr/hdp/2.3.0.0-2425/hadoop/conf jar 
/usr/hdp/current/hadoop-mapreduce-client/hadoop-mapreduce-examples-2.*.jar 
wordcount /user/ambari-qa/mapredsmokeinput /user/ambari-qa/mapredsmokeoutput' 
returned 255. java.lang.IllegalArgumentException: 
java.net.UnknownHostException: nameservice
        at 
org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)
        at 
org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:312)
        at 
org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:178)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:665)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:601)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
        at 
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
        at 
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:354)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
        at 
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.addInputPath(FileInputFormat.java:518)
        at org.apache.hadoop.examples.WordCount.main(WordCount.java:83)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: java.net.UnknownHostException: nameservice
{code}

That means there was some issue with the hdfs-site.xml i think. the 2nd All 
service check passed so may be after a while stuff was correct but this points 
to some orchestration issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to