[
https://issues.apache.org/jira/browse/YARN-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16605489#comment-16605489
]
Oleksandr Shevchenko edited comment on YARN-8749 at 9/6/18 8:59 AM:
--------------------------------------------------------------------
YARN has the information about a type of each application in
ApplicationSubmissionContext. We can implement this in
RMAppManager#createAndPopulateNewRMApp() the same as ACL check for a queue. And
add some additional property for Fair and Capacity schedulers.
For example:
{code}
<allocations>
<queue name="root">
<queue name="q1">
<accessibleAppTypes>SPARK</accessibleAppTypes>
</queue>
</queue>
</allocations>
{code}
In this case "q1" will have list of accessible application types wich contains
only "SPARK" type. As the result we can submit only Spark application.
Applications with some other types (YARN, TEZ etc) will be rejected.
Could someone evaluate this feature and approach? And if no one objects I would
like to start working on this.
Thanks a lot for any comments.
was (Author: oshevchenko):
YARN has the information about a type of each application in
ApplicationSubmissionContext. We can implement this in
RMAppManager#createAndPopulateNewRMApp() the same as ACL check for a queue. And
add some additional property for Fair and Capacity schedulers.
For example:
<allocations>
<queue name="root">
<queue name="q1">
<accessibleAppTypes>SPARK</accessibleAppTypes>
</queue>
</queue>
</allocations>
In this case "q1" will have list of accessible application types wich contains
only "SPARK" type. As the result we can submit only Spark application.
Applications with some other types (YARN, TEZ etc) will be rejected.
Could someone evaluate this feature and approach? And if no one objects I would
like to start working on this.
Thanks a lot for any comments.
> Restrict job submission to queue based on apptype
> -------------------------------------------------
>
> Key: YARN-8749
> URL: https://issues.apache.org/jira/browse/YARN-8749
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: RM, scheduler
> Reporter: Oleksandr Shevchenko
> Assignee: Oleksandr Shevchenko
> Priority: Minor
>
> The proposed possibility here is adding a new property for queue tuning to
> allow submit an application to queue only with the allowed types. If an
> application has a different type from queue allowed types, the application
> should be rejected.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
