How about spark stream app itself? Does the ec2 script also provide means for daemonizing and monitoring spark streaming apps which are supposed to run 24/7? If not, any suggestions for how to do this?
On Thu, Feb 27, 2014 at 8:23 PM, Tathagata Das <[email protected]>wrote: > Zookeeper is automatically set up in the cluster as Spark uses Zookeeper. > However, you have to setup your own input source like Kafka or Flume. > > TD > > > On Thu, Feb 27, 2014 at 10:32 AM, Aureliano Buendia > <[email protected]>wrote: > >> >> >> >> On Thu, Feb 27, 2014 at 6:17 PM, Tathagata Das < >> [email protected]> wrote: >> >>> Yes! Spark streaming programs are just like any spark program and so any >>> ec2 cluster setup using the spark-ec2 scripts can be used to run spark >>> streaming programs as well. >>> >> >> Great. Does it come with any input source support as well? (Eg kafka >> requires setting up zookeeper). >> >> >>> >>> >>> >>> On Thu, Feb 27, 2014 at 10:11 AM, Aureliano Buendia < >>> [email protected]> wrote: >>> >>>> Hi, >>>> >>>> Does the ec2 support for spark 0.9 also include spark streaming? If >>>> not, is there an equivalent? >>>> >>>> >>> >> >
