Adam Vogel created SPARK-6403:
---------------------------------
Summary: Launch master as spot instance on EC2
Key: SPARK-6403
URL: https://issues.apache.org/jira/browse/SPARK-6403
Project: Spark
Issue Type: New Feature
Components: EC2
Affects Versions: 1.2.1
Reporter: Adam Vogel
Priority: Minor
Fix For: 1.2.1
Currently the spark_ec2.py script only supports requesting slaves as spot
instances. Launching the master as a spot instance has potential cost savings,
at the risk of losing the Spark cluster without warning. Unless users include
logic for relaunching slaves when lost, it is usually the case that all slaves
are lost simultaneously. Thus, for jobs which do not require resilience to
losing spot instances, being able to launch the master as a spot instance saves
money.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
