Repository: spark Updated Branches: refs/heads/branch-1.6 0d96c5453 -> fe2cf342e
[DOCUMENTATION] doc fix of job scheduling spark.shuffle.service.enabled is spark application related configuration, it is not necessary to set it in yarn-site.xml Author: Jeff Zhang <[email protected]> Closes #10657 from zjffdu/doc-fix. (cherry picked from commit 00d9261724feb48d358679efbae6889833e893e0) Signed-off-by: Marcelo Vanzin <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fe2cf342 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/fe2cf342 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/fe2cf342 Branch: refs/heads/branch-1.6 Commit: fe2cf342e2eddd7414bacf9f5702042a20c6d50f Parents: 0d96c54 Author: Jeff Zhang <[email protected]> Authored: Fri Jan 8 11:38:46 2016 -0800 Committer: Marcelo Vanzin <[email protected]> Committed: Fri Jan 8 11:39:19 2016 -0800 ---------------------------------------------------------------------- docs/job-scheduling.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/fe2cf342/docs/job-scheduling.md ---------------------------------------------------------------------- diff --git a/docs/job-scheduling.md b/docs/job-scheduling.md index 36327c6..6c587b3 100644 --- a/docs/job-scheduling.md +++ b/docs/job-scheduling.md @@ -91,7 +91,7 @@ pre-packaged distribution. 2. Add this jar to the classpath of all `NodeManager`s in your cluster. 3. In the `yarn-site.xml` on each node, add `spark_shuffle` to `yarn.nodemanager.aux-services`, then set `yarn.nodemanager.aux-services.spark_shuffle.class` to -`org.apache.spark.network.yarn.YarnShuffleService` and `spark.shuffle.service.enabled` to true. +`org.apache.spark.network.yarn.YarnShuffleService`. 4. Restart all `NodeManager`s in your cluster. All other relevant configurations are optional and under the `spark.dynamicAllocation.*` and --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
