Hi All,
I have created a spark cluster on EC2 using spark-ec2 script. Whenever more
data is there to be processed I would like to add new slaves to existing
cluster and would like to remove slave node when the data to be processed is
low.
It seems currently spark-ec2 doesn't have option to
You'll have to restart the cluster.. create copy of your existing slave..
add it to slave files in master restart the cluster
Mayur Rustagi
Ph: +1 (760) 203 3257
http://www.sigmoidanalytics.com
@mayur_rustagi https://twitter.com/mayur_rustagi
On Tue, Jun 3, 2014 at 4:30 PM, Sirisha Devineni