GitHub user mariusvniekerk reopened a pull request:
https://github.com/apache/spark/pull/15666
[SPARK-11421] [Core][Python][R] Added ability for addJar to augment the
current classloader
## What changes were proposed in this pull request?
Adds a flag to sc.addJar to add the jar to the current classloader
## How was this patch tested?
Unit tests, manual tests
This is a continuation of the pull request in
https://github.com/apache/spark/pull/9313 and is mostly a rebase of that moved
to master with SparkR additions.
cc @holdenk
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mariusvniekerk/spark SPARK-11421
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15666.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15666
----
commit 6fb5d66e7669ebe0e8a515e02b1276e1bab652a2
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-28T00:26:17Z
Squashed content from pull request #9313
commit 6a6e98a0fcc7f388009f36b8a31664bda2ccf5d9
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-28T00:26:29Z
Remove _loadClass method since we dont need it anymore under py4j 0.10
commit 2b1e98e50feb7180b94f7b9e304634566f163718
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-28T00:26:36Z
Expose addJar to sparkR as well
commit 7f37d3a060d574bd6c38539ec896fbc4c94060f3
Author: mariusvniekerk <[email protected]>
Date: 2016-10-29T13:24:40Z
Style fixes
commit 9d838b35b53b1e4fdcf39721b4f638ead9e40fcd
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-29T20:15:32Z
Adjust test suite to test add jar in scala as well.
commit d4416d92610affd363701fd08dc53eb720566130
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-29T21:19:16Z
Fixed scala test not working due to incorrect classloader being used.
commit fccb141dd9e6d36db242997f1c6f3e007caa514f
Author: Marius van Niekerk <[email protected]>
Date: 2016-10-30T00:15:27Z
Fixed typo with test.
commit 26b39de51f9a76b121ebcb70079072dfcc9972bd
Author: Marius van Niekerk <[email protected]>
Date: 2016-11-01T01:46:07Z
Fixed documentation.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
