GitHub user ConeyLiu opened a pull request:
https://github.com/apache/spark/pull/17859
[SPARK-20595][Deploy]Parse the 'SPARK_EXECUTOR_INSTANCES' into the parsed
arguments
## What changes were proposed in this pull request?
Currently, when we set the parameter `SPARK_EXECUTOR_INSTANCES` in the
`spark-env.sh`, it seems that the parameter doesn't parsed by Spark. So this
patch parse the 'SPARK_EXECUTOR_INSTANCES' into the parsed arguments.
## How was this patch tested?
Existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ConeyLiu/spark build
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17859.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17859
----
commit f98ee8f6d92a81e996e1a610c8535b0e4b96c341
Author: Xianyang Liu <[email protected]>
Date: 2017-05-04T07:23:20Z
add option which parse the executor numbers from env
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
