?That's another option indeed ;) ________________________________ De : Shuai Lin <[email protected]> Envoy? : mercredi 4 mai 2016 09:12 ? : user Objet : Re: Spark job run periodically through Chronos
Why not using docker? You can build a docker image for your app, and the image can be based on https://hub.docker.com/r/mesosphere/spark/ . On Wed, May 4, 2016 at 2:53 PM, Cecile, Adam <[email protected]<mailto:[email protected]>> wrote: Hello, I need to run a Spark job every N minutes and I'm wondering what is the easier/proper way to do that. I was thinking about using Chronos but if I do so, it seems I'll have to use spark-submit anyway. Should I: * Bundle spark-submit tool along my app * Make sure spark-submit command is available on all mesos-slave * Forget this and do something better ?Thanks in advance, Best regards, Adam.

