zhuqi created YARN-10514:
----------------------------
Summary: Introduce a dominant resource based schedule policy to
increase the resource utilization, avoid heavy cluster resource fragments.
Key: YARN-10514
URL: https://issues.apache.org/jira/browse/YARN-10514
Project: Hadoop YARN
Issue Type: Improvement
Affects Versions: 3.3.0, 3.4.0
Reporter: zhuqi
Assignee: zhuqi
When we schedule in multi node lookup policy for async scheduling, or just use
heartbeat update based scheduling, we both meet scheduling fragments. When
cpu-intensive jobs or gpu-intensive or memory-intensive etc, the cluster will
meet heavy waste of resources, so this issue will help to move scheduler
support dominant resource based schedule, to help our cluster get better
resource utilization.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]