Repository: spark Updated Branches: refs/heads/master af2a2a263 -> d34f79c8d
[SPARK-2945][YARN][Doc]add doc for spark.executor.instances https://issues.apache.org/jira/browse/SPARK-2945 spark.executor.instances works. As this JIRA recommended, we should add docs for this common config. Author: WangTaoTheTonic <[email protected]> Closes #4350 from WangTaoTheTonic/SPARK-2945 and squashes the following commits: 4c3913a [WangTaoTheTonic] not compatible with dynamic allocation 5fa9c46 [WangTaoTheTonic] add doc for spark.executor.instances Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d34f79c8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d34f79c8 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d34f79c8 Branch: refs/heads/master Commit: d34f79c8db79ae461fadae190446ebc19091bec9 Parents: af2a2a2 Author: WangTaoTheTonic <[email protected]> Authored: Fri Feb 6 11:57:02 2015 -0800 Committer: Andrew Or <[email protected]> Committed: Fri Feb 6 11:58:22 2015 -0800 ---------------------------------------------------------------------- docs/running-on-yarn.md | 7 +++++++ 1 file changed, 7 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/d34f79c8/docs/running-on-yarn.md ---------------------------------------------------------------------- diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 68ab127..2b93eef 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -105,6 +105,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.executor.instances</code></td> + <td>2</td> + <td> + The number of executors. Note that this property is incompatible with <code>spark.dynamicAllocation.enabled</code>. + </td> +</tr> +<tr> <td><code>spark.yarn.executor.memoryOverhead</code></td> <td>executorMemory * 0.07, with minimum of 384 </td> <td> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
