[
https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16301611#comment-16301611
]
Arun Suresh commented on YARN-7679:
-----------------------------------
Thanks for starting the discussion. We actually introduced YARN-6355 to solve a
similar problem. Essentially, we can use the pre-processing framework to add a
processor that limits requests from misbehaving apps. This can be done in the
RM.
In production, we actually use an AMRMProxy plugin, introduced in YARN-2884,
installed on the NM to intercept AM calls to RM to perform the job limiting.
Since we are using the AMRMProxy anyway for federation.
> Application blacklist to drop misbehave AM requests
> ---------------------------------------------------
>
> Key: YARN-7679
> URL: https://issues.apache.org/jira/browse/YARN-7679
> Project: Hadoop YARN
> Issue Type: New Feature
> Components: client, RM
> Reporter: Weiwei Yang
> Labels: admin, command-line
>
> Sometimes there might be some malicious or mis-behave AMs that keep sending
> invalid resource requests to RM, this causes resource wastes. If such
> application provides online services, we cannot simply KILL them. Instead it
> will be extremely useful if RM can black list such applications, drop their
> requests. So admin could have time to check and then decide how to process.
> Propose to add an admin command to blacklist applications.
> Open this JIRA for discussion, will upload a design doc shortly.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
