[jira] [Commented] (RANGER-3323) Ranger Hive Table lookup is not working.
[
https://issues.apache.org/jira/browse/RANGER-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17370579#comment-17370579
]
Nitin Galave commented on RANGER-3323:
--
Committed to Apache
[master|https://github.com/apache/ranger/commit/3db20090ba448f844eee69661e11f008ca259128]
branch.
Committed to
[ranger-2.2|https://github.com/apache/ranger/commit/9651c029e95bf09bb7054308fee1abb1a236d49f]
branch.
> Ranger Hive Table lookup is not working.
>
>
> Key: RANGER-3323
> URL: https://issues.apache.org/jira/browse/RANGER-3323
> Project: Ranger
> Issue Type: Improvement
> Components: Ranger
>Reporter: Nitin Galave
>Assignee: Nitin Galave
>Priority: Major
> Attachments: 0001-RANGER-3323.patch
>
>
> Ranger Hive table lookup is failing with the below error message.
> {code:java}
> 2021-06-23 09:13:36,206 INFO
> org.apache.hadoop.hive.metastore.thrift.TCustomSocket: [main]: Buffer size
> for TSocket is: 8192
> 2021-06-23 09:13:36,211 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: 51: get_multi_table : db={ tbls=null
> 2021-06-23 09:13:36,211 INFO
> org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-10-thread-74]:
> ugi=rangerlookup/mmrngrhive-1.mmrngrhive.root.hwx.s...@root.hwx.site
> ip=172.27.28.139cmd=get_multi_table : db={ tbls=null
> 2021-06-23 09:13:36,212 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: 51: Opening raw store with implementation
> class:org.apache.hadoop.hive.metastore.ObjectStore
> 2021-06-23 09:13:36,213 INFO org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with
> PersistenceManager: null will be shutdown
> 2021-06-23 09:13:36,214 INFO org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with
> PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@60bbf86c
> created in the thread with id: 292
> 2021-06-23 09:13:36,216 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: Created RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981 from thread id: 292
> 2021-06-23 09:13:36,219 WARN org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: Failed to get database hive.{, returning
> NoSuchObjectException
> 2021-06-23 09:13:36,219 ERROR
> org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-10-thread-74]:
> UnknownDBException(message:Could not find database hive.{: {)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.getTableObjectsByName(ObjectStore.java:2255)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> at com.sun.proxy.$Proxy32.getTableObjectsByName(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getTableObjectsInternal(HiveMetaStore.java:3773)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_objects_by_name_req(HiveMetaStore.java:3740)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:160)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:121)
> at com.sun.proxy.$Proxy41.get_table_objects_by_name_req(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18454)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18438)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:63
Re: Review Request 73435: RANGER-3323 : Ranger Hive Table lookup is not working.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73435/#review223195
---
Ship it!
Ship It!
- Mehul Parikh
On June 28, 2021, 10:27 a.m., Nitin Galave wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73435/
> ---
>
> (Updated June 28, 2021, 10:27 a.m.)
>
>
> Review request for ranger, Dhaval Shah, Dineshkumar Yadav, Harshal Chavan,
> Jayendra Parab, Kishor Gollapalliwar, Madhan Neethiraj, Mahesh Bandal, Mehul
> Parikh, Pradeep Agrawal, and Velmurugan Periasamy.
>
>
> Bugs: RANGER-3323
> https://issues.apache.org/jira/browse/RANGER-3323
>
>
> Repository: ranger
>
>
> Description
> ---
>
> Ranger Hive table lookup is failing with the below error message.
>
> 2021-06-23 09:13:36,206 INFO
> org.apache.hadoop.hive.metastore.thrift.TCustomSocket: [main]: Buffer size
> for TSocket is: 8192
> 2021-06-23 09:13:36,211 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: 51: get_multi_table : db={ tbls=null
> 2021-06-23 09:13:36,211 INFO
> org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-10-thread-74]:
> ugi=rangerlookup/mmrngrhive-1.mmrngrhive.root.hwx.s...@root.hwx.site
> ip=172.27.28.139cmd=get_multi_table : db={ tbls=null
> 2021-06-23 09:13:36,212 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: 51: Opening raw store with implementation
> class:org.apache.hadoop.hive.metastore.ObjectStore
> 2021-06-23 09:13:36,213 INFO org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with
> PersistenceManager: null will be shutdown
> 2021-06-23 09:13:36,214 INFO org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with
> PersistenceManager: org.datanucleus.api.jdo.JDOPersistenceManager@60bbf86c
> created in the thread with id: 292
> 2021-06-23 09:13:36,216 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
> [pool-10-thread-74]: Created RawStore:
> org.apache.hadoop.hive.metastore.ObjectStore@619f1981 from thread id: 292
> 2021-06-23 09:13:36,219 WARN org.apache.hadoop.hive.metastore.ObjectStore:
> [pool-10-thread-74]: Failed to get database hive.{, returning
> NoSuchObjectException
> 2021-06-23 09:13:36,219 ERROR
> org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-10-thread-74]:
> UnknownDBException(message:Could not find database hive.{: {)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.getTableObjectsByName(ObjectStore.java:2255)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> at com.sun.proxy.$Proxy32.getTableObjectsByName(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getTableObjectsInternal(HiveMetaStore.java:3773)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_objects_by_name_req(HiveMetaStore.java:3740)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:160)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:121)
> at com.sun.proxy.$Proxy41.get_table_objects_by_name_req(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18454)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18438)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:
Review Request 73435: RANGER-3323 : Ranger Hive Table lookup is not working.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73435/
---
Review request for ranger, Dhaval Shah, Dineshkumar Yadav, Harshal Chavan,
Jayendra Parab, Kishor Gollapalliwar, Madhan Neethiraj, Mahesh Bandal, Mehul
Parikh, Pradeep Agrawal, and Velmurugan Periasamy.
Bugs: RANGER-3323
https://issues.apache.org/jira/browse/RANGER-3323
Repository: ranger
Description
---
Ranger Hive table lookup is failing with the below error message.
2021-06-23 09:13:36,206 INFO
org.apache.hadoop.hive.metastore.thrift.TCustomSocket: [main]: Buffer size for
TSocket is: 8192
2021-06-23 09:13:36,211 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
[pool-10-thread-74]: 51: get_multi_table : db={ tbls=null
2021-06-23 09:13:36,211 INFO
org.apache.hadoop.hive.metastore.HiveMetaStore.audit: [pool-10-thread-74]:
ugi=rangerlookup/mmrngrhive-1.mmrngrhive.root.hwx.s...@root.hwx.site
ip=172.27.28.139cmd=get_multi_table : db={ tbls=null
2021-06-23 09:13:36,212 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
[pool-10-thread-74]: 51: Opening raw store with implementation
class:org.apache.hadoop.hive.metastore.ObjectStore
2021-06-23 09:13:36,213 INFO org.apache.hadoop.hive.metastore.ObjectStore:
[pool-10-thread-74]: RawStore:
org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with PersistenceManager:
null will be shutdown
2021-06-23 09:13:36,214 INFO org.apache.hadoop.hive.metastore.ObjectStore:
[pool-10-thread-74]: RawStore:
org.apache.hadoop.hive.metastore.ObjectStore@619f1981, with PersistenceManager:
org.datanucleus.api.jdo.JDOPersistenceManager@60bbf86c created in the thread
with id: 292
2021-06-23 09:13:36,216 INFO org.apache.hadoop.hive.metastore.HiveMetaStore:
[pool-10-thread-74]: Created RawStore:
org.apache.hadoop.hive.metastore.ObjectStore@619f1981 from thread id: 292
2021-06-23 09:13:36,219 WARN org.apache.hadoop.hive.metastore.ObjectStore:
[pool-10-thread-74]: Failed to get database hive.{, returning
NoSuchObjectException
2021-06-23 09:13:36,219 ERROR
org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-10-thread-74]:
UnknownDBException(message:Could not find database hive.{: {)
at
org.apache.hadoop.hive.metastore.ObjectStore.getTableObjectsByName(ObjectStore.java:2255)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
at com.sun.proxy.$Proxy32.getTableObjectsByName(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getTableObjectsInternal(HiveMetaStore.java:3773)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_objects_by_name_req(HiveMetaStore.java:3740)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:160)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:121)
at com.sun.proxy.$Proxy41.get_table_objects_by_name_req(Unknown Source)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18454)
at
org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$get_table_objects_by_name_req.getResult(ThriftHiveMetastore.java:18438)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
at
org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
at
org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1898)
at
org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:638)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at
java
