Jason Lowe created YARN-3508:

             Summary: Preemption processing occuring on the main RM dispatcher
                 Key: YARN-3508
                 URL: https://issues.apache.org/jira/browse/YARN-3508
             Project: Hadoop YARN
          Issue Type: Bug
          Components: resourcemanager, scheduler
    Affects Versions: 2.6.0
            Reporter: Jason Lowe

We recently saw the RM for a large cluster lag far behind on the AsyncDispacher 
event queue.  The AsyncDispatcher thread was consistently blocked on the 
highly-contended CapacityScheduler lock trying to dispatch preemption-related 
events for RMContainerPreemptEventDispatcher.  Preemption processing should 
occur on the scheduler event dispatcher thread or a separate thread to avoid 
delaying the processing of other events in the primary dispatcher queue.

This message was sent by Atlassian JIRA

Reply via email to