Merge pull request #153 from ankurdave/stop-spot-cluster

Enable stopping and starting a spot cluster

Clusters launched using `--spot-price` contain an on-demand master and spot 
slaves. Because EC2 does not support stopping spot instances, the spark-ec2 
script previously could only destroy such clusters.

This pull request makes it possible to stop and restart a spot cluster.
* The `stop` command works as expected for a spot cluster: the master is 
stopped and the slaves are terminated.
* To start a stopped spot cluster, the user must invoke `launch 
--use-existing-master`. This launches fresh spot slaves but resumes the 
existing master.


Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/87f2f4e5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/87f2f4e5
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/87f2f4e5

Branch: refs/heads/master
Commit: 87f2f4e5c2812351cdd1b2e35e2b12f62eeb3fdc
Parents: b8bf04a bc9f7ea
Author: Matei Zaharia <[email protected]>
Authored: Tue Nov 12 16:26:09 2013 -0800
Committer: Matei Zaharia <[email protected]>
Committed: Tue Nov 12 16:26:09 2013 -0800

----------------------------------------------------------------------
 ec2/spark_ec2.py | 51 ++++++++++++++++++++++++++++++++-------------------
 1 file changed, 32 insertions(+), 19 deletions(-)
----------------------------------------------------------------------


Reply via email to