Github user yolandagao commented on a diff in the pull request:
https://github.com/apache/spark/pull/9272#discussion_r44742954
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/ClientWrapper.scala ---
@@ -150,6 +152,21 @@ private[hive] class ClientWrapper(
val original = Thread.currentThread().getContextClassLoader
// Switch to the initClassLoader.
Thread.currentThread().setContextClassLoader(initClassLoader)
+
+ val sparkConf = new SparkConf
--- End diff --
@yhuai Sorry for the late response. I did the testing after changing to
SparkEnv.get.conf but it didn't work. The reason is that Yarn Client.scala
resets property spark.yarn.keytab by appending some random strings to keytab
file name during setupCredentials, which will be used as the link name in
distributed cache. This one should be actually separated from the original
keytab setting, e.g. using different property names.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
