[ 
https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

lujie reassigned YARN-8703:
---------------------------

    Assignee: lujie

> Localized resource may leak on disk if container is killed while localizing
> ---------------------------------------------------------------------------
>
>                 Key: YARN-8703
>                 URL: https://issues.apache.org/jira/browse/YARN-8703
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: nodemanager
>            Reporter: Jason Lowe
>            Assignee: lujie
>            Priority: Major
>         Attachments: hadoop-hires-nodemanager-hadoop15.log
>
>
> If a container is killed while localizing then it releases all of its 
> resources.  If the resource count goes to zero and it is in the DOWNLOADING 
> state then the resource bookkeeping is removed in the resource tracker.  
> Shortly afterwards the localizer could heartbeat in and report the successful 
> localization of the resource that was just removed.  When the 
> LocalResourcesTrackerImpl receives the LOCALIZED event but does not find the 
> corresponding LocalResource for the event then it simply logs a "localized 
> without a location" warning.  At that point I think the localized resource 
> has been leaked on the disk since the NM has removed bookkeeping for the 
> resource without removing it on disk.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to