[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=611460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-611460
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 15/Jun/21 17:00
Start Date: 15/Jun/21 17:00
Worklog Time Spent: 10m
Work Description: amazingSaltFish opened a new pull request #592:
URL: https://github.com/apache/griffin/pull/592
url:https://issues.apache.org/jira/projects/GRIFFIN/issues/GRIFFIN-363?filter=allopenissues
1. add new property hive.krb5conf.path.
2. solve hive metastore kerberos error.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 611460)
Remaining Estimate: 23h 50m (was: 24h)
Time Spent: 10m
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 10m
> Remaining Estimate: 23h 50m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
> ~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_131] at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_131] at
>
[GitHub] [griffin] amazingSaltFish opened a new pull request #592: For task GRIFFIN-363:
amazingSaltFish opened a new pull request #592: URL: https://github.com/apache/griffin/pull/592 url:https://issues.apache.org/jira/projects/GRIFFIN/issues/GRIFFIN-363?filter=allopenissues 1. add new property hive.krb5conf.path. 2. solve hive metastore kerberos error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MenghuiWan updated GRIFFIN-363:
---
Description:
i am sorry for my english is not well.
This is my problem:
i try to use griffin for data quality projects.
our enviroment is CDH 6.1.1 cluster with kerberos.
i want to connect hive then i set up all configurations about kerberos by user
guide.
but i found hive connection had failed.
error log is:
{quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
[518] : Waiting 1 seconds before next connection
attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
[434] : Trying to connect to metastore with URI
thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
main] o.a.t.t.TSaslTransport [315] : SASL negotiation failure
javax.security.sasl.SaslException: GSS initiate failed at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
~[?:1.8.0_131] at
org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
~[hadoop-common-2.7.1.jar:?] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_131] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
~[?:1.8.0_131] at
org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:622)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:456)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1321)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1160)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
[jira] [Updated] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MenghuiWan updated GRIFFIN-363:
---
Description:
i am sorry for my english is not well.
This is my problem:
i try to use griffin for data quality projects.
our enviroment is CDH 6.1.1 cluster with kerberos.
i want to connect hive then i set up all configurations about kerberos by user
guide.
but i found hive connection had failed.
error log is:
{quote}
2021-06-15 13:33:01.418 WARN 102938 --- [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 WARN 102938 --- [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 INFO 102938 --- [ main] h.metastore
[518] : Waiting 1 seconds before next connection
attempt.2021-06-15 13:33:02.419 INFO 102938 --- [ main] h.metastore
[434] : Trying to connect to metastore with URI
thrift://svlhdp011.csvw.com:90832021-06-15 13:33:02.422 ERROR 102938 --- [
main] o.a.t.t.TSaslTransport [315] : SASL negotiation
failure
javax.security.sasl.SaslException: GSS initiate failed at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
~[?:1.8.0_131] at
org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
~[hadoop-common-2.7.1.jar:?] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_131] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
~[?:1.8.0_131] at
org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:622)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:456)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1321)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1160)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
[jira] [Updated] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
MenghuiWan updated GRIFFIN-363:
---
Description:
i am sorry for my english is not well.
This is my problem:
i try to use griffin for data quality projects.
our enviroment is CDH 6.1.1 cluster with kerberos.
i want to connect hive then i set up all configurations about kerberos by user
guide.
but i found hive connection had failed.
error log is:
{code:java}
2021-06-15 13:33:01.418 WARN 102938 --- [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 WARN 102938 --- [ main] h.metastore
[487] : Failed to connect to the MetaStore
Server...2021-06-15 13:33:01.418 INFO 102938 --- [ main] h.metastore
[518] : Waiting 1 seconds before next connection
attempt.2021-06-15 13:33:02.419 INFO 102938 --- [ main] h.metastore
[434] : Trying to connect to metastore with URI
thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 --- [
main] o.a.t.t.TSaslTransport [315] : SASL negotiation failure
javax.security.sasl.SaslException: GSS initiate failed at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
~[?:1.8.0_131] at
org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
~[libthrift-0.9.3.jar:0.9.3] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
~[hadoop-common-2.7.1.jar:?] at
org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
~[hive-shims-common-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
~[hive-metastore-2.2.0.jar:2.2.0] at
org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_131] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
~[?:1.8.0_131] at
org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:622)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:456)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1321)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1160)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:555)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
~[spring-beans-5.1.9.RELEASE.jar:5.1.9.RELEASE] at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
