Also, in this talk http://www.youtube.com/watch?v=OhpjgaBVUtU on using
spark streaming in production, the author seems to have missed the topic of
how to manage cloud instances.
On Fri, Feb 28, 2014 at 6:48 PM, Aureliano Buendia buendia...@gmail.comwrote:
What's the updated way of deploying
Yeah, the Spark on EMR bootstrap scripts referenced
herehttp://aws.amazon.com/articles/4926593393724923need some
polishing. I had a lot of trouble just getting through that
tutorial. And yes, the version of Spark they're using is 0.8.1.
On Fri, Feb 28, 2014 at 2:39 PM, Aureliano Buendia
Yes! Spark streaming programs are just like any spark program and so any
ec2 cluster setup using the spark-ec2 scripts can be used to run spark
streaming programs as well.
On Thu, Feb 27, 2014 at 10:11 AM, Aureliano Buendia buendia...@gmail.comwrote:
Hi,
Does the ec2 support for spark 0.9
On Thu, Feb 27, 2014 at 6:17 PM, Tathagata Das
tathagata.das1...@gmail.comwrote:
Yes! Spark streaming programs are just like any spark program and so any
ec2 cluster setup using the spark-ec2 scripts can be used to run spark
streaming programs as well.
Great. Does it come with any input
Yes, the default spark EC2 cluster runs the standalone deploy mode. Since
Spark 0.9, the standalone deploy mode allows you to launch the driver app
within the cluster itself and automatically restart it if it fails. You can
read about launching your app inside the cluster
