GitHub user jerryshao opened a pull request:
https://github.com/apache/spark/pull/21178
[SPARK-24110][Thrift-Server] Avoid UGI.loginUserFromKeytab in STS
## What changes were proposed in this pull request?
Spark ThriftServer will call UGI.loginUserFromKeytab twice in
initialization. This is unnecessary and will cause various potential problems,
like Hadoop IPC failure after 7 days, or RM failover issue and so on.
So here we need to remove all the unnecessary login logics and make sure
UGI in the context never be created again.
Note this is actually a HS2 issue, If later on we upgrade supported Hive
version, the issue may already be fixed in Hive side.
## How was this patch tested?
Local verification in secure cluster.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jerryshao/apache-spark SPARK-24110
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21178.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21178
----
commit fd48235e5a835f4a701c4ce303fbef1d74b2f095
Author: jerryshao <sshao@...>
Date: 2018-04-27T07:21:52Z
Avoid UGI.loginUserFromKeytab in STS
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
