Why do't you explore Livy. You can use the Rest API to submit the jobs - https://community.hortonworks.com/articles/151164/how-to-submit-spark-application-through-livy-rest.html
On Thu, Nov 1, 2018 at 12:52 PM 崔苗(数据与人工智能产品开发部) <0049003...@znv.com> wrote: > Hi, > we want to use spark in our java web service , compute data in spark > cluster according to request,now we have two probles: > 1、 how to get sparkSession of remote spark cluster (spark on yarn mode) , > we want to keep one sparkSession to execute all data compution; > 2、how to submit to remote spark cluster in java code instead of > spark-submit , as we want to execute spark code in reponse server; > > Thanks for any replys > 0049003208 > 0049003...@znv.com > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=0049003208&uid=0049003208%40znv.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%220049003208%40znv.com%22%5D> > 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81> 定制 >