My question is this ACL control is provided by Yarn or you have an in-house facility to handle this?
If you're referring to this #ContainerLaunchContext#setApplicationACLs, I think current Spark on Yarn doesn't support this. From feature level, this is doable in the current yarn/client code, no need to use REST API. setApplicationACLs <https://hadoop.apache.org/docs/stable2/api/src-html/org/apache/hadoop/yarn/api/records/ContainerLaunchContext.html#line.197> (Map <http://docs.oracle.com/javase/7/docs/api/java/util/Map.html?is-external=true> <ApplicationAccessType <https://hadoop.apache.org/docs/stable2/api/org/apache/hadoop/yarn/api/records/ApplicationAccessType.html> ,String <http://docs.oracle.com/javase/7/docs/api/java/lang/String.html?is-external=true> > acls) On Tue, Mar 22, 2016 at 10:28 PM, [email protected] < [email protected]> wrote: > Hi, Saisai, > Thanks a lot for your reply. We want to have a way which we can control > the user who submit spark jobs with program so that we can have security > control on our data safety. So is there any good way for that? > > ------------------------------ > 阎志涛(Tony) > > 北京腾云天下科技有限公司 > ------------------------------------------------------------------------- > ------------------------------- > 邮箱：[email protected] > 电话：13911815695 > 微信： zhitao_yan > QQ ： 4707059 > 地址：北京市东城区东直门外大街39号院2号楼航空服务大厦602室 > 邮编：100027 > > -------------------------------------------------------------------------------------------------------- > TalkingData.com <http://talkingdata.com/> - 让数据说话 > > > *From:* Saisai Shao <[email protected]> > *Date:* 2016-03-22 18:03 > *To:* [email protected] > *CC:* user <[email protected]> > *Subject:* Re: Is there a way to submit spark job to your by YARN REST > API? > I'm afraid currently it is not supported by Spark to submit application > through Yarn REST API. However Yarn AMRMClient is functionally equal to > REST API, not sure which specific features are you referring? > > Thanks > Saisai > > On Tue, Mar 22, 2016 at 5:27 PM, [email protected] < > [email protected]> wrote: > >> Hi, All, >> We are trying to build a data processing workflow which will call >> different spark jobs and we are using YARN. Because we want to constraint >> ACL for those spark jobs, so we need to submit spark job to use Yarn REST >> API( which we can pass application acl as parameters. So is there any Spark >> API which can support that? If no, is there any third party solutions for >> that? >> >> >> Thanks and Regards, >> >> >> ------------------------------ >> 阎志涛(Tony) >> >> 北京腾云天下科技有限公司 >> ------------------------------------------------------------------------- >> ------------------------------- >> 邮箱：[email protected] >> 电话：13911815695 >> 微信： zhitao_yan >> QQ ： 4707059 >> 地址：北京市东城区东直门外大街39号院2号楼航空服务大厦602室 >> 邮编：100027 >> >> -------------------------------------------------------------------------------------------------------- >> TalkingData.com <http://talkingdata.com/> - 让数据说话 >> > >
