Adam Vogel created SPARK-6403: --------------------------------- Summary: Launch master as spot instance on EC2 Key: SPARK-6403 URL: https://issues.apache.org/jira/browse/SPARK-6403 Project: Spark Issue Type: New Feature Components: EC2 Affects Versions: 1.2.1 Reporter: Adam Vogel Priority: Minor Fix For: 1.2.1
Currently the spark_ec2.py script only supports requesting slaves as spot instances. Launching the master as a spot instance has potential cost savings, at the risk of losing the Spark cluster without warning. Unless users include logic for relaunching slaves when lost, it is usually the case that all slaves are lost simultaneously. Thus, for jobs which do not require resilience to losing spot instances, being able to launch the master as a spot instance saves money. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org