Repository: spark Updated Branches: refs/heads/branch-1.1 af7695456 -> 3e3cd5ac8
[SPARK-4642] Add description about spark.yarn.queue to running-on-YARN document. Added descriptions about these parameters. - spark.yarn.queue Modified description about the defalut value of this parameter. - spark.yarn.submit.file.replication Author: Masayoshi TSUZUKI <[email protected]> Closes #3500 from tsudukim/feature/SPARK-4642 and squashes the following commits: ce99655 [Masayoshi TSUZUKI] better gramatically. 21cf624 [Masayoshi TSUZUKI] Removed intentionally undocumented properties. 88cac9b [Masayoshi TSUZUKI] [SPARK-4642] Documents about running-on-YARN needs update Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3e3cd5ac Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3e3cd5ac Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3e3cd5ac Branch: refs/heads/branch-1.1 Commit: 3e3cd5ac829b9d75bbbf837721ec7252c005862d Parents: af76954 Author: Masayoshi TSUZUKI <[email protected]> Authored: Wed Dec 3 13:16:24 2014 -0800 Committer: Andrew Or <[email protected]> Committed: Wed Dec 3 13:20:18 2014 -0800 ---------------------------------------------------------------------- docs/running-on-yarn.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/3e3cd5ac/docs/running-on-yarn.md ---------------------------------------------------------------------- diff --git a/docs/running-on-yarn.md b/docs/running-on-yarn.md index 63d28b8..a27873c 100644 --- a/docs/running-on-yarn.md +++ b/docs/running-on-yarn.md @@ -30,7 +30,7 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </tr> <tr> <td><code>spark.yarn.submit.file.replication</code></td> - <td>3</td> + <td>The default HDFS replication (usually 3)</td> <td> HDFS replication level for the files uploaded into HDFS for the application. These include things like the Spark jar, the app jar, and any distributed cache files/archives. </td> @@ -92,6 +92,13 @@ Most of the configs are the same for Spark on YARN as for other deployment modes </td> </tr> <tr> + <td><code>spark.yarn.queue</code></td> + <td>default</td> + <td> + The name of the YARN queue to which the application is submitted. + </td> +</tr> +<tr> <td><code>spark.yarn.jar</code></td> <td>(none)</td> <td> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
