Sangjin Lee created YARN-2600:

             Summary: if the container is killed during localization 
outstanding public cache localization tasks should be cancelled
                 Key: YARN-2600
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.4.0
            Reporter: Sangjin Lee

We came across a situation (partly related with HDFS-7005) where a large number 
of public cache localization tasks were queued in the public localizer thread 
pool but the container is killed during localization (as it went over the 

What's not helpful in this situation is that any work item that's queued will 
still be serviced by the resource localization service which is wasteful. And 
that may further delay localization efforts of other containers.

It would be good if we can cancel the pending localization tasks when the 
container is killed.

This message was sent by Atlassian JIRA

Reply via email to