Zian Chen created YARN-8178:
-------------------------------
Summary: [Umbrella] Resource Over-commitment Based on
Opportunistic Container Preemption
Key: YARN-8178
URL: https://issues.apache.org/jira/browse/YARN-8178
Project: Hadoop YARN
Issue Type: New Feature
Components: capacity scheduler
Reporter: Zian Chen
We want to provide an opportunistic container-based solution to achieve more
aggressive preemption with shorter preemption monitoring interval.
Instead of allowing applications to allocate resources with a mix of guaranteed
and opportunistic containers, we allow newly submitted applications to only
contain guaranteed containers. Meanwhile, we change the preemption logic to,
instead of killing containers, demote guaranteed containers into opportunistic
ones, so that when there are new applications submitted, we can ensure that
these containers can be launched by preempting opportunistic containers.
This approach is related to YARN-1011 but achieves ver-commitment in a
different way, however, we rely on opportunistic container part implemented in
YARN-1011 to make our design work well.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
