Github user preecet commented on the pull request:
https://github.com/apache/spark/pull/11495#issuecomment-191797212
Copy of recent developemrnt mailing list comment.
I have been testing 1.6.1RC1 using the IBM Java SDK.
I notice a problem ( with the
org.apache.spark.sql.hive.client.VersionsSuite tests ) after a recent Spark
1.6.1 change.
Pull request -
https://github.com/apache/spark/commit/f7898f9e2df131fa78200f6034508e74a78c2a44
The change introduced a dependency on
org.apache.hadoop.hive.cli.CliSessionState in
org.apache.spark.sql.hive.client.ClientWrapper.
In particular the following test was added
if (originalState.isInstanceOf[CliSessionState]) {
The problem is that VersionsSuite test uses an isolated classloader in
order to test various versions of Hive. However the classpath of the isolated
classloader does not contain CliSessionState.
The behaviour of isInstanceOf[CliSessionState]) is JVM vendor specific. In
particular whether this code causes the CliSessionState class to be loaded. (
It does not for openjdk, but does for IBM JDK ). Hence this call can throw a
classnotfound exception.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
