[
https://issues.apache.org/jira/browse/YARN-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhaohui Xin updated YARN-9276:
------------------------------
Description:
In some scenarios, applications will request nonexistent resource name in this
cluster, such as nonexistent hosts or racks.
Obviously, we should filter or degrade these invaild resource requests actively.
This is especially effective when HDFS and Yarn are deployed on different
nodes, and the scheduling throughput of one of our clusters has improved by 5X.
> Filter non-existent resource requests actively
> ----------------------------------------------
>
> Key: YARN-9276
> URL: https://issues.apache.org/jira/browse/YARN-9276
> Project: Hadoop YARN
> Issue Type: Bug
> Components: RM, scheduler
> Affects Versions: 2.6.0, 2.7.0, 2.8.0, 2.9.0, 3.0.0, 3.1.0
> Reporter: Zhaohui Xin
> Assignee: Zhaohui Xin
> Priority: Major
>
> In some scenarios, applications will request nonexistent resource name in
> this cluster, such as nonexistent hosts or racks.
> Obviously, we should filter or degrade these invaild resource requests
> actively.
> This is especially effective when HDFS and Yarn are deployed on different
> nodes, and the scheduling throughput of one of our clusters has improved by
> 5X.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
