[
https://issues.apache.org/jira/browse/FLINK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-13431:
----------------------------
Priority: Critical (was: Blocker)
> NameNode HA configuration was not loaded when running HiveConnector on Yarn
> ---------------------------------------------------------------------------
>
> Key: FLINK-13431
> URL: https://issues.apache.org/jira/browse/FLINK-13431
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Affects Versions: 1.9.0
> Environment: CDH 5.13
> Hive 1.2.1
> Flink 1.9.0
> Reporter: Hongtao Zhang
> Assignee: Hongtao Zhang
> Priority: Critical
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Reading the Hive table (version 1.2.1) and write into the hdfs file
>
> launch the job from SQL Client
>
>
> *StackTrace:*
>
> Caused by: java.lang.IllegalArgumentException:
> [java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
> at
> org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)
> at
> org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310)
> at
> org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:668)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:604)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2598)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
> at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:97)
> at
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
> at
> org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:205)
> at
> org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313)
> at
> org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:164)
> at
> org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:67)
> at
> org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:256)
> ... 22 more
> Caused by:
> [java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
