[
https://issues.apache.org/jira/browse/SPARK-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112070#comment-14112070
]
Xiangrui Meng commented on SPARK-3213:
--------------------------------------
I usually put a single-slave cluster in stop state, with all tools I need
installed, e.g., optimized BLAS/LAPACK libraries, and the latest version of
Spark. It is faster to use "Launch More Like This" to duplicate the slave node
and expand the cluster, than using the spark-ec2 scripts to launch a new
cluster and then re-configure everything manually.
> spark_ec2.py cannot find slave instances launched with "Launch More Like This"
> ------------------------------------------------------------------------------
>
> Key: SPARK-3213
> URL: https://issues.apache.org/jira/browse/SPARK-3213
> Project: Spark
> Issue Type: Improvement
> Components: EC2
> Affects Versions: 1.1.0
> Reporter: Joseph K. Bradley
> Priority: Blocker
> Attachments: Screen Shot 2014-08-25 at 6.45.35 PM.png, Screen Shot
> 2014-08-26 at 1.22.32 PM.png
>
>
> spark_ec2.py cannot find all slave instances. In particular:
> * I created a master & slave and configured them.
> * I created new slave instances from the original slave ("Launch More Like
> This").
> * I tried to relaunch the cluster, and it could only find the original slave.
> Old versions of the script worked. The latest working commit which edited
> that .py script is: a0bcbc159e89be868ccc96175dbf1439461557e1
> There may be a problem with this PR:
> [https://github.com/apache/spark/pull/1899].
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
