GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/2166
[SPARK-3264] Allow users to set executor Spark home in Mesos
The executors and the driver may not share the same Spark home. There is
currently one way to set the executor side Spark home in Mesos, through setting
`spark.home`. However, this is neither documented nor intuitive. This PR adds a
more specific config `spark.mesos.executor.home` and exposes this to the user.
@liancheng @tnachen
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark mesos-spark-home
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/2166.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2166
----
commit ca7846d302c239571117111adf916911d21770f0
Author: Andrew Or <[email protected]>
Date: 2014-08-27T20:13:04Z
Add more specific configuration for executor Spark home in Mesos
commit f6abb2ee9e39ae745d6dc874b4bf106a6cc16116
Author: Andrew Or <[email protected]>
Date: 2014-08-27T20:30:38Z
Document spark.mesos.executor.home
commit b87965ea7ce83732b9f52fabf469111d5e28ef15
Author: Andrew Or <[email protected]>
Date: 2014-08-27T20:31:41Z
Merge branch 'master' of github.com:apache/spark into mesos-spark-home
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
