Is using oozie binding for you? If you have flexibility to change workflow engine then take a look at Luigi (https://github.com/spotify/luigi) .
Thanks Ashutosh On Mon, Mar 7, 2016 at 9:22 PM, Benjamin Kim <[email protected]> wrote: > To comment… > > At my company, we have not gotten it to work in any other mode than local. > If we try any of the yarn modes, it fails with a “file does not exist” > error when trying to locate the executable jar. I mentioned this to the Hue > users group, which we used for this, and they replied that the Spark Action > is very basic implementation and that they will be writing their own for > production use. > > That’s all I know... > > On Mar 7, 2016, at 1:18 AM, Deepak Sharma <[email protected]> wrote: > > There is Spark action defined for oozie workflows. > Though I am not sure if it supports only Java SPARK jobs or Scala jobs as > well. > https://oozie.apache.org/docs/4.2.0/DG_SparkActionExtension.html > Thanks > Deepak > > On Mon, Mar 7, 2016 at 2:44 PM, Divya Gehlot <[email protected]> > wrote: > >> Hi, >> >> Could somebody help me by providing the steps /redirect me to >> blog/documentation on how to run Spark job written in scala through Oozie. >> >> Would really appreciate the help. >> >> >> >> Thanks, >> Divya >> > > > > -- > Thanks > Deepak > www.bigdatabig.com > www.keosha.net > > >
