I need to setup a spark cluster for Spark streaming and scheduled batch jobs and adhoc queries. Please give me some suggestions. Can this be done in standalone mode.
Right now we have a spark cluster in standalone mode on AWS EC2 running spark streaming application. Can we run spark batch jobs and zeppelin on the same. Do we need a better resource manager like Mesos? Are there any companies or individuals that can help in setting this up? Thank you. -Anna
