GitHub user dragos opened a pull request:
https://github.com/apache/spark/pull/9282
[SPARK-10986][Mesos] Set the context class loader in the Mesos executor
backend.
See [SPARK-10986](https://issues.apache.org/jira/browse/SPARK-10986) for
details.
This fixes the `ClassNotFoundException` for Spark classes in the serializer.
I am not sure this is the right way to handle the class loader, but there
isn't any clear docs on how the classloader is supposed to be handled. I am
open to suggestions (but I tried this fix on a real Mesos cluster and it fixed
the isse).
@tnachen @andrewor14
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dragos/spark issue/mesos-classloader
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/9282.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #9282
----
commit ec1c11b6f599d950abb5c0496c2c85c5951f9fa7
Author: Iulian Dragos <[email protected]>
Date: 2015-10-26T17:00:18Z
Set the context class loader in the Mesos executor backend.
This fixes the `ClassNotFoundException` for Spark classes in the serializer.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
