[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615383=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615383
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 11:09
Start Date: 27/Jun/21 11:09
Worklog Time Spent: 10m
Work Description: lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659304138
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
> Since kerberos doesnt apply to just hive but hadoop services in
general, the "hive." prefix can be removed from all these configs.
emmm, kerberos have many keytabs for different user,like hive,hdfs,livy and
so on.
i can see many keytab files name like hive.keytab,hdfs.keytab...
how about keep the prefix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615383)
Remaining Estimate: 22h 20m (was: 22.5h)
Time Spent: 1h 40m (was: 1.5h)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 1h 40m
> Remaining Estimate: 22h 20m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
>
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615384=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615384
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 11:09
Start Date: 27/Jun/21 11:09
Worklog Time Spent: 10m
Work Description: lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659304138
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
> Since kerberos doesnt apply to just hive but hadoop services in
general, the "hive." prefix can be removed from all these configs.
emmm, kerberos have many keytabs for different user,like hive,hdfs,livy and
so on.
i can see many keytab files name like hive.keytab,hdfs.keytab...
how about keep the prefix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615384)
Remaining Estimate: 22h 10m (was: 22h 20m)
Time Spent: 1h 50m (was: 1h 40m)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 1h 50m
> Remaining Estimate: 22h 10m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
>
[GitHub] [griffin] lovelyqincai commented on a change in pull request #592: For task GRIFFIN-363:
lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659304138
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
> Since kerberos doesnt apply to just hive but hadoop services in
general, the "hive." prefix can be removed from all these configs.
emmm, kerberos have many keytabs for different user,like hive,hdfs,livy and
so on.
i can see many keytab files name like hive.keytab,hdfs.keytab...
how about keep the prefix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [griffin] lovelyqincai commented on a change in pull request #592: For task GRIFFIN-363:
lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659304138
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
> Since kerberos doesnt apply to just hive but hadoop services in
general, the "hive." prefix can be removed from all these configs.
emmm, kerberos have many keytabs for different user,like hive,hdfs,livy and
so on.
i can see many keytab files name like hive.keytab,hdfs.keytab...
how about keep the prefix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615382
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 10:47
Start Date: 27/Jun/21 10:47
Worklog Time Spent: 10m
Work Description: lovelyqincai commented on pull request #592:
URL: https://github.com/apache/griffin/pull/592#issuecomment-869141142
> @amazingSaltFish can you add some test cases and add more details to this
JIRA and this PR.
I lost this scene, but I solved the problem this way...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615382)
Remaining Estimate: 22.5h (was: 22h 40m)
Time Spent: 1.5h (was: 1h 20m)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 1.5h
> Remaining Estimate: 22.5h
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
> ~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_131] at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_131]
[GitHub] [griffin] lovelyqincai commented on pull request #592: For task GRIFFIN-363:
lovelyqincai commented on pull request #592: URL: https://github.com/apache/griffin/pull/592#issuecomment-869141142 > @amazingSaltFish can you add some test cases and add more details to this JIRA and this PR. I lost this scene, but I solved the problem this way... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615381=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615381
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 10:45
Start Date: 27/Jun/21 10:45
Worklog Time Spent: 10m
Work Description: lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659301139
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
ok, I accept your suggestion
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615381)
Remaining Estimate: 22h 40m (was: 22h 50m)
Time Spent: 1h 20m (was: 1h 10m)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 1h 20m
> Remaining Estimate: 22h 40m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
> ~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
>
[GitHub] [griffin] lovelyqincai commented on a change in pull request #592: For task GRIFFIN-363:
lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659301139
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
ok, I accept your suggestion
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [griffin] lovelyqincai commented on a change in pull request #592: For task GRIFFIN-363:
lovelyqincai commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659300098
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
+private String keytabPath;
+
+@Value("${hive.keytab.user}")
+private String keytabUser;
+
+@Value("${hive.need.kerberos}")
+private String needKerberos;
Review comment:
emmm,last pr for this variable 'hive.need.kerberos' i also think it type
is boolean.
but in org.apache.griffin.core.metastore.hive.HiveMetaStoreServiceJdbcImpl
line 73: needKerberos define as string.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615379=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615379
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 10:28
Start Date: 27/Jun/21 10:28
Worklog Time Spent: 10m
Work Description: chitralverma commented on pull request #592:
URL: https://github.com/apache/griffin/pull/592#issuecomment-869138900
@amazingSaltFish can you add some test cases and add more details to this
JIRA and this PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615379)
Remaining Estimate: 23h (was: 23h 10m)
Time Spent: 1h (was: 50m)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 1h
> Remaining Estimate: 23h
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.griffin.core.metastore.hive.HiveMetaStoreProxy.initHiveMetastoreClient(HiveMetaStoreProxy.java:68)
> ~[service-0.7.0-SNAPSHOT.jar:0.7.0-SNAPSHOT] at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_131] at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_131] at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498)
> ~[?:1.8.0_131] at
>
[GitHub] [griffin] chitralverma commented on pull request #592: For task GRIFFIN-363:
chitralverma commented on pull request #592: URL: https://github.com/apache/griffin/pull/592#issuecomment-869138900 @amazingSaltFish can you add some test cases and add more details to this JIRA and this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615378=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615378
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 10:27
Start Date: 27/Jun/21 10:27
Worklog Time Spent: 10m
Work Description: chitralverma commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659298650
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
+private String keytabPath;
+
+@Value("${hive.keytab.user}")
+private String keytabUser;
+
+@Value("${hive.need.kerberos}")
+private String needKerberos;
+
+@PostConstruct
+public void init() throws IOException {
+if ( needKerberos != null && "true".equalsIgnoreCase(needKerberos) &&
hiveKrb5confPath != null) {
+System.setProperty("java.security.krb5.conf", hiveKrb5confPath);
Review comment:
This can be a constant.
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
Since kerberos doesnt apply to just hive but hadoop services in general,
the "hive." prefix can be removed from all these configs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615378)
Remaining Estimate: 23h 10m (was: 23h 20m)
Time Spent: 50m (was: 40m)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 50m
> Remaining Estimate: 23h 10m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
>
[GitHub] [griffin] chitralverma commented on a change in pull request #592: For task GRIFFIN-363:
chitralverma commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659298650
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
+private String keytabPath;
+
+@Value("${hive.keytab.user}")
+private String keytabUser;
+
+@Value("${hive.need.kerberos}")
+private String needKerberos;
+
+@PostConstruct
+public void init() throws IOException {
+if ( needKerberos != null && "true".equalsIgnoreCase(needKerberos) &&
hiveKrb5confPath != null) {
+System.setProperty("java.security.krb5.conf", hiveKrb5confPath);
Review comment:
This can be a constant.
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
Review comment:
Since kerberos doesnt apply to just hive but hadoop services in general,
the "hive." prefix can be removed from all these configs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Work logged] (GRIFFIN-363) Hive kerberos for Griffin error
[
https://issues.apache.org/jira/browse/GRIFFIN-363?focusedWorklogId=615364=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-615364
]
ASF GitHub Bot logged work on GRIFFIN-363:
--
Author: ASF GitHub Bot
Created on: 27/Jun/21 08:35
Start Date: 27/Jun/21 08:35
Worklog Time Spent: 10m
Work Description: chitralverma commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659285098
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
+private String keytabPath;
+
+@Value("${hive.keytab.user}")
+private String keytabUser;
+
+@Value("${hive.need.kerberos}")
+private String needKerberos;
Review comment:
Can be a boolean.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
---
Worklog Id: (was: 615364)
Remaining Estimate: 23h 20m (was: 23.5h)
Time Spent: 40m (was: 0.5h)
> Hive kerberos for Griffin error
> ---
>
> Key: GRIFFIN-363
> URL: https://issues.apache.org/jira/browse/GRIFFIN-363
> Project: Griffin
> Issue Type: Bug
> Components: Service Module
>Affects Versions: 0.6.0
> Environment: CentOS 7
>Reporter: MenghuiWan
>Priority: Minor
> Labels: kerberos
> Original Estimate: 24h
> Time Spent: 40m
> Remaining Estimate: 23h 20m
>
> i am sorry for my english is not well.
>
> This is my problem:
> i try to use griffin for data quality projects.
> our enviroment is CDH 6.1.1 cluster with kerberos.
> i want to connect hive then i set up all configurations about kerberos by
> user guide.
> but i found hive connection had failed.
>
> error log is:
> {quote}2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 WARN 102938 — [ main] h.metastore
> [487] : Failed to connect to the MetaStore
> Server...2021-06-15 13:33:01.418 INFO 102938 — [ main] h.metastore
> [518] : Waiting 1 seconds before next connection
> attempt.2021-06-15 13:33:02.419 INFO 102938 — [ main] h.metastore
> [434] : Trying to connect to metastore with URI
> thrift://..com:90832021-06-15 13:33:02.422 ERROR 102938 — [
> main] o.a.t.t.TSaslTransport [315] : SASL negotiation
> failure
> javax.security.sasl.SaslException: GSS initiate failed at
> com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
> ~[?:1.8.0_131] at
> org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
> ~[libthrift-0.9.3.jar:0.9.3] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_131] at
> javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_131] at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> ~[hadoop-common-2.7.1.jar:?] at
> org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49)
> ~[hive-shims-common-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:478)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:286)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:211)
> ~[hive-metastore-2.2.0.jar:2.2.0] at
>
[GitHub] [griffin] chitralverma commented on a change in pull request #592: For task GRIFFIN-363:
chitralverma commented on a change in pull request #592:
URL: https://github.com/apache/griffin/pull/592#discussion_r659285098
##
File path:
service/src/main/java/org/apache/griffin/core/metastore/hive/HiveMetaStoreProxy.java
##
@@ -55,6 +59,28 @@ Licensed to the Apache Software Foundation (ASF) under one
private IMetaStoreClient client = null;
+@Value("${hive.krb5conf.path}")
+private String hiveKrb5confPath;
+
+@Value("${hive.keytab.path}")
+private String keytabPath;
+
+@Value("${hive.keytab.user}")
+private String keytabUser;
+
+@Value("${hive.need.kerberos}")
+private String needKerberos;
Review comment:
Can be a boolean.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
