Hongtao Zhang created FLINK-13431:
-------------------------------------
Summary: NameNode HA configuration was not loaded when running
HiveConnector on Yarn
Key: FLINK-13431
URL: https://issues.apache.org/jira/browse/FLINK-13431
Project: Flink
Issue Type: Bug
Components: Connectors / Hive
Affects Versions: 1.9.0
Environment: CDH 5.13
Hive 1.2.1
Flink 1.9.0
Reporter: Hongtao Zhang
Reading the Hive table (version 1.2.1) and write into the hdfs file
launch the job from SQL Client
*StackTrace:*
Caused by: java.lang.IllegalArgumentException:
[java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
at
org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:374)
at
org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310)
at
org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:176)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:668)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:604)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2598)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2632)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2614)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
at
org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:97)
at
org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
at
org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:205)
at
org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313)
at
org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:164)
at
org.apache.flink.batch.connectors.hive.HiveTableInputFormat.createInputSplits(HiveTableInputFormat.java:67)
at
org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:256)
... 22 more
Caused by:
[java.net.UnknownHostException|http://java.net.unknownhostexception/]: idc-nn
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
