GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/6909
[SPARK-8498] Add regression test for SPARK-8470
**Summary of the problem in SPARK-8470.** When using `HiveContext` to
create a data frame of a user case class, Spark throws
`scala.reflect.internal.MissingRequirementError` when it tries to infer the
schema using reflection. This is caused by `HiveContext` silently overwriting
the context class loader containing the user classes. This issue is already
fixed in #6891.
**What this issue is about.** We closed SPARK-8470 as a duplicate because
it is a different manifestation of the same problem. This issue does NOT fix
SPARK-8470, but only adds regression tests for it. Due to the complexity of the
reproduction, this requires us to pre-package a special test jar and include it
in the Spark project itself.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark SPARK-8498
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6909.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6909
----
commit 90fe614376c86951d02c56cf61cdd848fe824338
Author: Andrew Or <[email protected]>
Date: 2015-06-19T21:29:00Z
Add regression test for SPARK-8470
Due to the complexity of the reproduction, this requires us to
pre-package a special test jar and include it in the Spark project
itself. This test jar is then used in HiveSparkSubmitSuite.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
