Yerui Sun created KYLIN-1910:
--------------------------------
Summary: Support Separate HBase Cluster with NN HA and Kerberos
Authentication
Key: KYLIN-1910
URL: https://issues.apache.org/jira/browse/KYLIN-1910
Project: Kylin
Issue Type: Improvement
Components: Job Engine
Affects Versions: v1.5.3
Reporter: Yerui Sun
Assignee: Yerui Sun
Since KYLIN-957, we've support separate hbase cluster deployment. However, it
didn't support hbase cluster with NameNode HA and Kerberos Authentication
perfectly.
The key point is the cube building MR job need to access two hdfs cluster, the
main cluster stored source data and the hbase cluster stored the cube result
data. The MR task couldn't access hbase cluster with HA qualified path, like
hdfs://hbase-cluster:8020/path, because that couldn't found dfs.nameservices
related configs of hbase cluster.
To solve this problem, we need to read the hbase cluster HA configs and set
into job conf.
Another point is about authentication tokens. During job submitting, the
Resource Manager try to renew all tokens, to ensure can keep tokens alive. The
hdfs token of hbase cluster renewing would cause exception, because that RM
couldn't found the hbase cluster HA configs.
This problem can be resolved with YARN-3021 support.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
