Jason Lowe created YARN-3508:
--------------------------------
Summary: Preemption processing occuring on the main RM dispatcher
Key: YARN-3508
URL: https://issues.apache.org/jira/browse/YARN-3508
Project: Hadoop YARN
Issue Type: Bug
Components: resourcemanager, scheduler
Affects Versions: 2.6.0
Reporter: Jason Lowe
We recently saw the RM for a large cluster lag far behind on the AsyncDispacher
event queue. The AsyncDispatcher thread was consistently blocked on the
highly-contended CapacityScheduler lock trying to dispatch preemption-related
events for RMContainerPreemptEventDispatcher. Preemption processing should
occur on the scheduler event dispatcher thread or a separate thread to avoid
delaying the processing of other events in the primary dispatcher queue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
