[
https://issues.apache.org/jira/browse/HIVE-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
chenruotao updated HIVE-27140:
------------------------------
Description:
In order to use proxy user to access hive metastore server with kerberos, I set
HADOOP_PROXY_USER = proxy user.
this is the code of HiveMetaStoreClient
!image-2023-03-14-20-51-32-317.png|width=606,height=393!
but when I run a spark job with hive metatsore client, the connection to hive
metatsore server always close
!image-2023-03-14-20-53-40-132.png|width=687,height=375!
and I notice that some log before close :
{color:#ff0000}Mestastore configuration hive.metastore.token.signature changed
from DelegationTokenForHiveMetaStoreServer to{color}
so we can find why the connection close always, hive metatsore client will
compare currentMetaVars with hiveconf
!image-2023-03-14-20-56-00-757.png|width=903,height=463!
but if we set HADOOP_PROXY_USER and init hive metatsore client, the
ConfVars.METASTORE_TOKEN_SIGNATURE always is set
!image-2023-03-14-21-00-18-049.png|width=905,height=592!
so I think this solutions can fix the bug:
ConfVars.METASTORE_TOKEN_SIGNATURE is no need to check in hive metatsore client
!image-2023-03-14-21-03-52-764.png|width=905,height=606!
obviously that is no more close
!image-2023-03-14-21-56-27-408.png|width=903,height=452!
was:
In order to use proxy user to access hive metastore server with kerberos, I set
HADOOP_PROXY_USER = proxy user.
this is the code of HiveMetaStoreClient
!image-2023-03-14-20-51-32-317.png|width=606,height=393!
but when I run a spark job with hive metatsore client, the connection to hive
metatsore server always close
!image-2023-03-14-20-53-40-132.png|width=687,height=375!
and I notice that some log before close :
{color:#FF0000}Mestastore configuration hive.metastore.token.signature changed
from DelegationTokenForHiveMetaStoreServer to{color}
so we can find why the connection close always, hive metatsore client will
compare currentMetaVars with hiveconf
!image-2023-03-14-20-56-00-757.png|width=903,height=463!
but if we set HADOOP_PROXY_USER and init hive metatsore client, the
ConfVars.METASTORE_TOKEN_SIGNATURE always is set
!image-2023-03-14-21-00-18-049.png|width=905,height=592!
so I think this solutions can fix the bug:
ConfVars.METASTORE_TOKEN_SIGNATURE is no need to check in hive metatsore client
!image-2023-03-14-21-03-52-764.png|width=905,height=606!
> Set HADOOP_PROXY_USER cause hiveMetaStoreClient close everytime
> ----------------------------------------------------------------
>
> Key: HIVE-27140
> URL: https://issues.apache.org/jira/browse/HIVE-27140
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 2.3.8, 3.1.2
> Reporter: chenruotao
> Assignee: chenruotao
> Priority: Major
> Attachments: image-2023-03-14-20-51-32-317.png,
> image-2023-03-14-20-53-40-132.png, image-2023-03-14-20-56-00-757.png,
> image-2023-03-14-21-00-18-049.png, image-2023-03-14-21-03-52-764.png,
> image-2023-03-14-21-56-06-605.png, image-2023-03-14-21-56-27-408.png
>
>
> In order to use proxy user to access hive metastore server with kerberos, I
> set HADOOP_PROXY_USER = proxy user.
> this is the code of HiveMetaStoreClient
> !image-2023-03-14-20-51-32-317.png|width=606,height=393!
> but when I run a spark job with hive metatsore client, the connection to
> hive metatsore server always close
> !image-2023-03-14-20-53-40-132.png|width=687,height=375!
> and I notice that some log before close :
> {color:#ff0000}Mestastore configuration hive.metastore.token.signature
> changed from DelegationTokenForHiveMetaStoreServer to{color}
> so we can find why the connection close always, hive metatsore client will
> compare currentMetaVars with hiveconf
> !image-2023-03-14-20-56-00-757.png|width=903,height=463!
> but if we set HADOOP_PROXY_USER and init hive metatsore client, the
> ConfVars.METASTORE_TOKEN_SIGNATURE always is set
> !image-2023-03-14-21-00-18-049.png|width=905,height=592!
> so I think this solutions can fix the bug:
> ConfVars.METASTORE_TOKEN_SIGNATURE is no need to check in hive metatsore
> client
> !image-2023-03-14-21-03-52-764.png|width=905,height=606!
> obviously that is no more close
> !image-2023-03-14-21-56-27-408.png|width=903,height=452!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
