yuandeqiao created AMBARI-23104:
-----------------------------------
Summary: ambari-hive-kerberos-cli
Key: AMBARI-23104
URL: https://issues.apache.org/jira/browse/AMBARI-23104
Project: Ambari
Issue Type: Story
Components: amvari-me
Environment: centos6.8 hdp-2.6.3.0
Reporter: yuandeqiao
在启用了kerberos 之前，登陆hive root 用户下，也就mkdir /user/root/ chown 一下就行了。
但是加上kerberos 后就不一样了
hive cli 登陆返回的异常：
[root@hive ~]# sudo -u hive hive
log4j:WARN No such property [maxFileSize] in
org.apache.log4j.DailyRollingFileAppender.
Logging initialized using configuration in
file:/etc/hive/2.6.3.0-235/0/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException:
java.lang.RuntimeException: Unable to instantiate
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:552)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.lang.RuntimeException: Unable to instantiate
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1566)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:92)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:138)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:110)
at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3526)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3558)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:533)
... 8 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1564)
... 14 more
Caused by: MetaException(message:Could not connect to meta store using any of
the URIs provided. Most recent failure:
org.apache.thrift.transport.TTransportException: GSS initiate failed
at
org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:316)
at
org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:487)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:282)
at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:76)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1564)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:92)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:138)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:110)
at
org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3526)
at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3558)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:533)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:534)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:282)
at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:76)
... 19 more
[root@hive ~]#
另外检查到/var/log/hive/hiveserver2.log日志可能的一些异常如下：
2018-02-28 17:07:24,671 INFO [HiveServer2-Handler-Pool: Thread-45]:
thrift.ThriftCLIService (ThriftCLIService.java:OpenSession(316)) - Client
protocol version: HIVE_CLI_SERVICE_PROTOCOL_V8
2018-02-28 17:07:24,671 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 1: Shutting down
the object store...
2018-02-28 17:07:24,671 INFO [HiveServer2-Handler-Pool: Thread-45]:
HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) -
ugi=hive/[email protected] ip=unknown-ip-addr cmd=Shutting down the object
store...
2018-02-28 17:07:24,672 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:logInfo(773)) - 1: Metastore
shutdown complete.
2018-02-28 17:07:24,672 INFO [HiveServer2-Handler-Pool: Thread-45]:
HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(317)) -
ugi=hive/[email protected] ip=unknown-ip-addr cmd=Metastore shutdown
complete.
2018-02-28 17:07:24,672 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:init(453)) - Begin calculating
metadata count metrics.
2018-02-28 17:07:24,816 WARN [HiveServer2-Handler-Pool: Thread-45]:
conf.HiveConf (HiveConf.java:initialize(3093)) - HiveConf of name
hive.internal.ss.authz.settings.applied.marker does not exist
2018-02-28 17:07:24,820 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:newRawStoreForConf(619)) - 1:
Opening raw store with implementation
class:org.apache.hadoop.hive.metastore.ObjectStore
2018-02-28 17:07:24,852 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.ObjectStore (ObjectStore.java:initializeHelper(383)) - ObjectStore,
initialize called
2018-02-28 17:07:24,981 WARN [HiveServer2-Handler-Pool: Thread-45]:
conf.HiveConf (HiveConf.java:initialize(3093)) - HiveConf of name
hive.internal.ss.authz.settings.applied.marker does not exist
2018-02-28 17:07:24,986 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(163)) - Using
direct SQL, underlying DB is OTHER
2018-02-28 17:07:24,986 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.ObjectStore (ObjectStore.java:setConf(297)) - Initialized ObjectStore
2018-02-28 17:07:24,990 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:init(455)) - Finished metadata
count metrics: 1 databases, 0 tables, 0 partitions.
2018-02-28 17:07:24,991 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_dbs] already exists. The old gauge will be overwritten,
but this is not recommended
2018-02-28 17:07:24,991 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_tables] already exists. The old gauge will be
overwritten, but this is not recommended
2018-02-28 17:07:24,991 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_partitions] already exists. The old gauge will be
overwritten, but this is not recommended
2018-02-28 17:07:25,014 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.ObjectStore (ObjectStore.java:initializeHelper(383)) - ObjectStore,
initialize called
2018-02-28 17:07:25,171 WARN [HiveServer2-Handler-Pool: Thread-45]:
conf.HiveConf (HiveConf.java:initialize(3093)) - HiveConf of name
hive.internal.ss.authz.settings.applied.marker does not exist
2018-02-28 17:07:25,181 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.MetaStoreDirectSql (MetaStoreDirectSql.java:<init>(163)) - Using
direct SQL, underlying DB is OTHER
2018-02-28 17:07:25,181 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.ObjectStore (ObjectStore.java:setConf(297)) - Initialized ObjectStore
2018-02-28 17:07:25,182 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:init(453)) - Begin calculating
metadata count metrics.
2018-02-28 17:07:25,185 INFO [HiveServer2-Handler-Pool: Thread-45]:
metastore.HiveMetaStore (HiveMetaStore.java:init(455)) - Finished metadata
count metrics: 1 databases, 0 tables, 0 partitions.
2018-02-28 17:07:25,185 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_dbs] already exists. The old gauge will be overwritten,
but this is not recommended
2018-02-28 17:07:25,185 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_tables] already exists. The old gauge will be
overwritten, but this is not recommended
2018-02-28 17:07:25,185 WARN [HiveServer2-Handler-Pool: Thread-45]:
metrics2.CodahaleMetrics (CodahaleMetrics.java:addGauge(299)) - A Gauge with
name [init_total_count_partitions] already exists. The old gauge will be
overwritten, but this is not recommended
2018-02-28 17:07:25,219 INFO [HiveServer2-Handler-Pool: Thread-45]:
session.SessionState (SessionState.java:createPath(682)) - Created local
directory: /tmp/7645338b-a770-4ee8-8eb4-5ffe663652e0_resources
2018-02-28 17:07:25,259 INFO [HiveServer2-Handler-Pool: Thread-45]:
session.SessionState (SessionState.java:createPath(682)) - Created HDFS
directory: /tmp/hive/ambari-qa/7645338b-a770-4ee8-8eb4-5ffe663652e0
2018-02-28 17:07:25,261 INFO [HiveServer2-Handler-Pool: Thread-45]:
session.SessionState (SessionState.java:createPath(682)) - Created local
directory: /tmp/hive/7645338b-a770-4ee8-8eb4-5ffe663652e0
2018-02-28 17:07:25,284 INFO [HiveServer2-Handler-Pool: Thread-45]:
session.SessionState (SessionState.java:createPath(682)) - Created HDFS
directory:
/tmp/hive/ambari-qa/7645338b-a770-4ee8-8eb4-5ffe663652e0/_tmp_space.db
2018-02-28 17:07:25,286 INFO [HiveServer2-Handler-Pool: Thread-45]:
session.HiveSessionImpl (HiveSessionImpl.java:setOperationLogSessionDir(274)) -
Operation log session directory is created:
/tmp/hive/operation_logs/7645338b-a770-4ee8-8eb4-5ffe663652e0
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
