GitHub user MattWhelan opened a pull request:
https://github.com/apache/spark/pull/4166
SPARK-5358: Rework the classloader impelementation.
The fundamental issue is that you can't change the delegation scheme
without overriding loadClass (rather than findClass). And, if you
override loadClass, you kind of have to do it in Java, because you need
a static initializer call to register yourself as parallel-capable.
This is an alternative to PR #4165. That PR requires Java 1.7. This
one sticks with 1.6, and implements the classloader as a trait, because
it can.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MattWhelan/spark greedyCL1.6
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4166.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4166
----
commit bc15951f649233269949833e8daebc51535ba966
Author: Matt Whelan <[email protected]>
Date: 2015-01-22T20:01:48Z
SPARK-5358: Rework the classloader impelementation.
The fundamental issue is that you can't change the delegation scheme
without overriding loadClass (rather than findClass). And, if you
override loadClass, you kind of have to do it in Java, because you need
a static initializer call to register yourself as parallel-capable.
commit 9283a36598b65214f5a73fc567eaeccc4182e617
Author: Matt Whelan <[email protected]>
Date: 2015-01-22T22:01:50Z
Added copyright header.
commit d6f3677b8fd1f31e961a4e9961dcb84c32653265
Author: Matt Whelan <[email protected]>
Date: 2015-01-22T22:30:23Z
SPARK-5358: Rework the classloader impelementation.
The fundamental issue is that you can't change the delegation scheme
without overriding loadClass (rather than findClass). And, if you
override loadClass, you kind of have to do it in Java, because you need
a static initializer call to register yourself as parallel-capable.
This is an alternative to PR #4165. That PR requires Java 1.7. This
one sticks with 1.6, and implements the classloader as a trait, because
it can.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
