Github user shivaram commented on the pull request:
https://github.com/apache/spark/pull/2290#issuecomment-54738774
@nchammas The default version for the EC2 script should be a released Spark
version (preferably the latest released version) -- This is because the
spark-ec2 scripts download the released binaries from S3 while setting up the
cluster. (https://github.com/mesos/spark-ec2/blob/v3/spark/init.sh#L84)
We do have an advanced option for using any git commit as the Spark
version, so you could use 1.2.0-SNAPSHOT (or `master`) with that. However that
means the script will clone from github and build Spark on EC2. As this adds
10-15 minutes to cluster launch we don't use this by default.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
