GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/16975
[SPARK-19522] Fix executor memory in local-cluster mode
## What changes were proposed in this pull request?
```
bin/spark-shell --master local-cluster[2,1,2048]
```
is supposed to launch 2 executors, each with 2GB of memory. However, when I
ran this in master, I only get executors with 1GB memory. This patch fixes this
problem.
## How was this patch tested?
`SparkSubmitSuite`, manual tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark local-cluster-executor-mem
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16975.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16975
----
commit db3773c8aeb44e69610c17ff5bc169d7085333ee
Author: Andrew Or <andrewo...@gmail.com>
Date: 2017-02-08T23:27:07Z
Fix propagation of executor memory in local-cluster mode
commit 1a5bdfeca931a624b82933772c57c605e02dc58d
Author: Andrew Or <andrewo...@gmail.com>
Date: 2017-02-17T16:47:44Z
Log warning if memory is explicitly set
commit b1a13dc3b1a59593945f0fb6d13683ed81acf9b7
Author: Andrew Or <andrewo...@gmail.com>
Date: 2017-02-17T16:48:16Z
Merge branch 'master' of github.com:apache/spark into
local-cluster-executor-mem
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
