Repository: spark Updated Branches: refs/heads/branch-1.1 e98aa5476 -> bf637e041
[SPARK-4652][DOCS] Add docs about spark-git-repo option There might be some cases when WIPS spark version need to be run on EC2 cluster. In order to setup this type of cluster more easily, add --spark-git-repo option description to ec2 documentation. Author: lewuathe <lewua...@me.com> Author: Josh Rosen <joshro...@databricks.com> Closes #3513 from Lewuathe/doc-for-development-spark-cluster and squashes the following commits: 6dae8ee [lewuathe] Wrap consistent with other descriptions cfaf9be [lewuathe] Add docs about spark-git-repo option (Editing / cleanup by Josh Rosen) (cherry picked from commit ab8177da2defab1ecd8bc0cd5a21f07be5b8d2c5) Signed-off-by: Josh Rosen <joshro...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bf637e04 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bf637e04 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bf637e04 Branch: refs/heads/branch-1.1 Commit: bf637e0414fb6a59d4b2462cf3ece6937ae591fe Parents: e98aa54 Author: lewuathe <lewua...@me.com> Authored: Thu Dec 4 15:14:36 2014 -0800 Committer: Josh Rosen <joshro...@databricks.com> Committed: Thu Dec 4 15:25:41 2014 -0800 ---------------------------------------------------------------------- docs/ec2-scripts.md | 5 +++++ 1 file changed, 5 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/bf637e04/docs/ec2-scripts.md ---------------------------------------------------------------------- diff --git a/docs/ec2-scripts.md b/docs/ec2-scripts.md index 156a727..1a588ad 100644 --- a/docs/ec2-scripts.md +++ b/docs/ec2-scripts.md @@ -76,6 +76,11 @@ another. specified version of Spark. VERSION can be a version number (e.g. "0.7.3") or a specific git hash. By default, a recent version will be used. +- `--spark-git-repo=<repository url>` will let you run a custom version of + Spark that is built from the given git repository. By default, the + [Apache Github mirror](https://github.com/apache/spark) will be used. + When using a custom Spark version, `--spark-version` must be set to git + commit hash, such as 317e114, instead of a version number. - If one of your launches fails due to e.g. not having the right permissions on your private key file, you can run `launch` with the `--resume` option to restart the setup process on an existing cluster. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org