Jason Lowe created YARN-7019:
--------------------------------
Summary: Ability for applications to notify YARN about container
reuse
Key: YARN-7019
URL: https://issues.apache.org/jira/browse/YARN-7019
Project: Hadoop YARN
Issue Type: New Feature
Reporter: Jason Lowe
During preemption calculations YARN can try to reduce the amount of work lost
by considering how long a container has been running. However when an
application framework like Tez reuses a container across multiple tasks it
changes the work lost calculation since the container has essentially
checkpointed between task assignments. It would be nice if applications could
inform YARN when a container has been reused/checkpointed and therefore is a
better candidate for preemption wrt. lost work than other, younger containers.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
