GitHub user guoxiaolongzte opened a pull request:
https://github.com/apache/spark/pull/18806
[SPARK-21600] The description of "this requires
spark.shuffle.service.enabled to be set" for the
spark.dynamicAllocation.enabled configuration item is not clear
## What changes were proposed in this pull request?
The description of "this requires spark.shuffle.service.enabled to be set"
for the spark.dynamicAllocation.enabled configuration item is not clear. I am
not sure how to set spark.shuffle.service.enabled is true or false, so that the
user to guess, resulting in doubts. All i have changed here, stressed that must
spark.shuffle.service.enabled to be set true.
When I set spark.dynamicAllocation.enabled=true, but set
spark.shuffle.service.enabled false, When I submit the spark-submit --master
yarn job, the program throws the exception.
## How was this patch tested?
manual tests
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/guoxiaolongzte/spark SPARK-21600
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18806.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18806
----
commit 4c8de9a46ea4a09334eaa31328cb9eea1c2eb6b1
Author: guoxiaolong <guo.xiaolo...@zte.com.cn>
Date: 2017-08-02T01:34:27Z
[SPARK-21600] The description of "this requires
spark.shuffle.service.enabled to be set" for the
spark.dynamicAllocation.enabled configuration item is not clear. I am not sure
how to set spark.shuffle.service.enabled is true or false, so that the user to
guess, resulting in doubts. All i have changed here, stressed that must
spark.shuffle.service.enabled to be set true.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
