Github user yhuai commented on the pull request:
https://github.com/apache/spark/pull/13236#issuecomment-221080895
We support different versions of Hive metastore (for example, Spark depends
on Hive 1.2.1 but we can talk to a metastore using Hive 0.12). Also, the Hadoop
used by this client can be different from the Hadoop used by Spark. We have a
IsolatedClientLoader for the class isolation purpose. So, it is possible that
we have to reload Hadoop classes (those classes are from a different version of
Hadoop than the Hadoop used by Spark). This is the reason that we need to have
a option to allow us load Hadoop classes instead of always sharing Hadoop
classes. Because of this, we cannot pass Configuration to HiveClientImpl.
At here, Hadoop Configuration is only the container of all users' Hadoop
settings.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
