GitHub user mengxr opened a pull request:
https://github.com/apache/spark/pull/1132
[SPARK-1112, 2156] Bootstrap to fetch the driver's Spark properties.
This is an alternative solution to #1124 . Before launching the executor
backend, we first fetch driver's spark properties and use it to overwrite
executor's spark properties. This should be better than #1124.
@pwendell Are there spark properties that might be different on the driver
and on the executors?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mengxr/spark akka-bootstrap
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1132.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1132
----
commit 4ab696a813889e75cb3a5d49bbfdf37e938d8dc5
Author: Xiangrui Meng <[email protected]>
Date: 2014-06-19T08:51:47Z
bootstrap to retrieve driver spark conf
commit 6f574b008d2840b5fbca1a1645791bd5491460d5
Author: Xiangrui Meng <[email protected]>
Date: 2014-06-19T09:23:47Z
increase slack size for akka
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
