GitHub user holdenk opened a pull request:
https://github.com/apache/spark/pull/217
[WIP] Spark 939 allow user jars to take precedence over spark jars
I still need to do a small bit of re-factoring [mostly the one Java file
I'll switch it back to a Scala file and use it in both the close loaders], but
comments on other things I should do would be great.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/spark
spark-939-allow-user-jars-to-take-precedence-over-spark-jars
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/217.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #217
----
commit bc2491756800b2712f0d927f3d889499448235a8
Author: Holden Karau <[email protected]>
Date: 2014-03-21T06:15:57Z
One loader workers.
commit b1729d179195e39cff553c0d05d972552bc7abec
Author: Holden Karau <[email protected]>
Date: 2014-03-21T21:14:04Z
Both class loaders compile. Now for testing
commit 01ef4df251aadf143706f88ce7cb19a0ad3d8d6c
Author: Holden Karau <[email protected]>
Date: 2014-03-21T21:15:07Z
Adda FakeClass for testing ClassLoader precedence options
commit 9e8b94d38d7f7403c8d8166c15a492f6233111e0
Author: Holden Karau <[email protected]>
Date: 2014-03-21T22:20:36Z
Doesn't quite work
commit 75aeade7a3a0d08548ab2e649f18c43d32463f98
Author: Holden Karau <[email protected]>
Date: 2014-03-22T23:50:58Z
Almost works
commit de85b5d34602b9f1282a498483877062c3cab31c
Author: Holden Karau <[email protected]>
Date: 2014-03-23T00:11:37Z
Clean up
commit ac8acbac1073da9f153503691a71755ad018e1d5
Author: Holden Karau <[email protected]>
Date: 2014-03-23T02:21:28Z
Add a test suite for the executor url class loader suite
commit 7e4f73c668f3aad87b68eace2dc69c2f4efa7df5
Author: Holden Karau <[email protected]>
Date: 2014-03-23T02:35:45Z
Remove bad import'
commit 30b152914f871e06d70951eb60622a6fc2dd5d56
Author: Holden Karau <[email protected]>
Date: 2014-03-23T02:37:28Z
Does not depend on being in my home directory
commit d7d32eda508dd9272f3dd504c5de514f5554a713
Author: Holden Karau <[email protected]>
Date: 2014-03-23T04:15:48Z
It works ish
commit f09425756a0c5e6eea63e0400aff0ffa78678ee8
Author: Holden Karau <[email protected]>
Date: 2014-03-23T04:22:20Z
It works comrade
commit 2af05d8bf8e5a8022d59a67413afcb130cc3b8d8
Author: Holden Karau <[email protected]>
Date: 2014-03-23T04:22:41Z
Test are good
commit 93c71dca87a36d5d50787cfe7ed66f7f8b079376
Author: Holden Karau <[email protected]>
Date: 2014-03-24T22:06:55Z
Fix parent calling class loader issue
commit 0bd8d926e8d982d37367549e6dc0a9f9d48c3a7d
Author: Holden Karau <[email protected]>
Date: 2014-03-24T22:16:12Z
Fix fall back with custom class loader and add a test for it
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---