[
https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309316#comment-14309316
]
Alex Rothberg edited comment on SPARK-5637 at 2/6/15 3:26 PM:
--------------------------------------------------------------
The major benefits to developers would be to allow spark_ec2 developers to
focus on setting up an instance of Spark on EC2 rather than having to maintain
code for starting the actual cluster itself. A large portion of the code in
spark_ec2 is responsible for just starting the EC2 instances (dealing with
auth, waiting for instances to come up, entering bid prices).
>From a users standpoint, they are able to take advantage of whatever
>additional features / config options starcluster offers for starting,
>configuring and monitoring clusters. Further, by being a plugin to
>StarCluster, the same cluster can more easily be shared for other purposes
>beyond just Spark as well since other plugins can be used.
[There have been others asking about this
ability|http://apache-spark-user-list.1001560.n3.nabble.com/Is-it-possible-to-launch-Apache-Spark-Cluster-on-Amazon-with-StarCluster-http-star-mit-edu-cluster-td2141.html]
was (Author: agrothberg):
The major benefits to developers would be to allow Spark developers to focus on
setting up an instance of Spark on EC2 rather than having to maintain code for
starting the actual cluster it self. A large portion of the code in spark_ec2
is responsible for just starting the EC2 instances.
>From a users standpoint, they are able to take advantage of whatever
>additional features / config options starcluster offers for starting,
>configuring and monitoring clusters. Further, by being a plugin to
>StarCluster, the same cluster can more easily be shared for other purposes
>beyond just Spark as well since other plugins can be used.
[There have been others asking about this
ability|http://apache-spark-user-list.1001560.n3.nabble.com/Is-it-possible-to-launch-Apache-Spark-Cluster-on-Amazon-with-StarCluster-http-star-mit-edu-cluster-td2141.html]
> Expose spark_ec2 as as StarCluster Plugin
> -----------------------------------------
>
> Key: SPARK-5637
> URL: https://issues.apache.org/jira/browse/SPARK-5637
> Project: Spark
> Issue Type: Improvement
> Components: EC2
> Reporter: Alex Rothberg
> Priority: Minor
>
> Starcluster has a lot features in place for stating EC2 instances and it
> would be great to have an option to leverage that as a plugin.
> See: http://star.mit.edu/cluster/docs/latest/index.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
