GitHub user mrdrozdov opened a pull request:
https://github.com/apache/spark/pull/5172
[SPARK-6474][EC2] Use EC2Connection.run_instances to launch clusters
Instead of using the following call in spark_ec2.py to launch clusters:
-
[`ec2.image.Image.run`](http://boto.readthedocs.org/en/latest/ref/ec2.html#boto.ec2.image.Image.run)
this patch uses the equivalent and more current call:
-
[`ec2.connection.EC2Connection.run_instances`](http://boto.readthedocs.org/en/latest/ref/ec2.html#boto.ec2.connection.EC2Connection.run_instances)
This is a useful change in that connection.run_instances exposes
additional features such as the capability of handling ebs_optimized
instances, which image.run does not handle.
This improvement was first suggested by @nchammas in a boto issue:
https://github.com/boto/boto/issues/3054
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mrdrozdov/spark ad-spark-6474-useRunInstances
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5172.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5172
----
commit 6d14787fe05b93aa029eec6707aa294edb056897
Author: Andrew Drozdov <[email protected]>
Date: 2015-03-24T18:03:21Z
[SPARK-6474][EC2] Use EC2Connection.run_instances to launch clusters
Instead of using the following call in spark_ec2.py to launch clusters:
-
[`ec2.image.Image.run`](http://boto.readthedocs.org/en/latest/ref/ec2.html#boto.ec2.image.Image.run)
this patch uses the equivalent and more current call:
-
[`ec2.connection.EC2Connection.run_instances`](http://boto.readthedocs.org/en/latest/ref/ec2.html#boto.ec2.connection.EC2Connection.run_instances)
This is a useful change in that connection.run_instances exposes
additional features such as the capability of handling ebs_optimized
instances, which image.run does not handle.
This improvement was first suggested by @nchammas in a boto issue:
https://github.com/boto/boto/issues/3054
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
