I haven’t used any Azure products but I did build a Livy hook and operator so I could submit concurrent spark jobs to EMR clusters. I was planning on contributing the code, but it’s kinda a pain haha. If your interested I can take another stab at getting the Livy hook and operator contributed.
On Fri, Jun 22, 2018 at 8:18 AM Naik Kaxil <k.n...@reply.com> wrote: > Hi all, > > > > Has anyone used the SparkSubmitOperator to submit Spark jobs on Azure > HDInsight cluster? Are you using Livy or spark-submit to run remote Spark > jobs? > > > > Regards, > > Kaxil > > > Kaxil Naik > > Data Reply > 2nd Floor, Nova South > 160 Victoria Street, Westminster > <https://maps.google.com/?q=160+Victoria+Street,+Westminster+%0D%0ALondon+SW1E+5LB+-+UK&entry=gmail&source=g> > London SW1E 5LB - UK > <https://maps.google.com/?q=160+Victoria+Street,+Westminster+%0D%0ALondon+SW1E+5LB+-+UK&entry=gmail&source=g> > phone: +44 (0)20 7730 6000 > k.n...@reply.com > www.reply.com > > [image: Data Reply] > -- Kyle Hamlin
