[
https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nicholas Chammas updated SPARK-5629:
------------------------------------
Description:
You can launch multiple clusters using spark-ec2. At some point, you might just
want to get some information about an existing cluster.
Use cases include:
* Wanting to check something about your cluster in the EC2 web console
* Wanting to feed information about your cluster to another tool (e.g. as
described in [SPARK-5627])
* Curiosity
So, in addition to the [existing
actions|https://github.com/apache/spark/blob/9b746f380869b54d673e3758ca5e4475f76c864a/ec2/spark_ec2.py#L115]:
* {{launch}}
* {{destroy}}
* {{login}}
* {{stop}}
* {{start}}
* {{get-master}}
* {{reboot-slaves}}
We add a new action, {{describe}}, which describes an existing cluster if given
a cluster name, and all clusters if not.
Parallels in similar tools include:
* [{{juju status}}|https://juju.ubuntu.com/docs/] from Ubuntu Juju
* [{{starcluster
listclusters}}|http://star.mit.edu/cluster/docs/latest/manual/getting_started.html?highlight=listclusters#logging-into-a-worker-node]
from MIT StarCluster
was:
If someone is programmatically launching a cluster with {{spark-ec2}}, they
might need to retrieve some information about the cluster like the master's
address so that they can connect to it from other tools.
Any such functionality should probably fall under the category of "Developer
API" that is not guaranteed to be stable.
> Add spark-ec2 action to return info about an existing cluster
> -------------------------------------------------------------
>
> Key: SPARK-5629
> URL: https://issues.apache.org/jira/browse/SPARK-5629
> Project: Spark
> Issue Type: Improvement
> Components: EC2
> Reporter: Nicholas Chammas
> Priority: Minor
>
> You can launch multiple clusters using spark-ec2. At some point, you might
> just want to get some information about an existing cluster.
> Use cases include:
> * Wanting to check something about your cluster in the EC2 web console
> * Wanting to feed information about your cluster to another tool (e.g. as
> described in [SPARK-5627])
> * Curiosity
> So, in addition to the [existing
> actions|https://github.com/apache/spark/blob/9b746f380869b54d673e3758ca5e4475f76c864a/ec2/spark_ec2.py#L115]:
> * {{launch}}
> * {{destroy}}
> * {{login}}
> * {{stop}}
> * {{start}}
> * {{get-master}}
> * {{reboot-slaves}}
> We add a new action, {{describe}}, which describes an existing cluster if
> given a cluster name, and all clusters if not.
> Parallels in similar tools include:
> * [{{juju status}}|https://juju.ubuntu.com/docs/] from Ubuntu Juju
> * [{{starcluster
> listclusters}}|http://star.mit.edu/cluster/docs/latest/manual/getting_started.html?highlight=listclusters#logging-into-a-worker-node]
> from MIT StarCluster
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
