Hello, Can someone, please, share the opinions on the options available for running spark streaming jobs on yarn? The first thing comes to my mind is to use slider. Googling for such experience didn't give me much. From my experience running the same jobs on mesos, I have two concerns: automatic scaling (not blocking the resources if they is no data in the stream) and the ui to manage the running jobs.
Thanks, Alex.