[
https://issues.apache.org/jira/browse/YARN-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896662#comment-15896662
]
Feng Yuan edited comment on YARN-6277 at 3/6/17 2:46 AM:
---------------------------------------------------------
Hi [~Naganarasimha],Like this:
In LocalDirAllocator#confChanged will check local-dir configuration if changed.
The RLS will timing change this conf because local disk breakdown.
And ShuffleHandler will also use LocalDirAllocator#confChanged because the
AllocatorPerContext is singleton,
but the conf of shuffleHandler is a clone version,so if the conf changed is nm
the sh`s conf is still old.
So if shuffleHandler invoke LocalDirAllocator#confChanged once nm will create a
FileSystem..
was (Author: feng yuan):
Hi [~Naganarasimha],Like this:
In LocalDirAllocator#confChanged will check local-dir configuration if changed.
The RLS will timing change this conf because local disk breakdown.
And ShuffleHandler will also use LocalDirAllocator#confChanged because the
AllocatorPerContext is singleton,
but the conf of shuffleHandler is a clone version,so if the conf changed is nm
the sh`s conf is still old.
So if shuffleHandler invoke LocalDirAllocator#confChanged once nm will create a
FileSystem..
> Nodemanager heap memory leak
> ----------------------------
>
> Key: YARN-6277
> URL: https://issues.apache.org/jira/browse/YARN-6277
> Project: Hadoop YARN
> Issue Type: Bug
> Components: nodemanager
> Affects Versions: 3.0.0-alpha2
> Reporter: Feng Yuan
> Assignee: Feng Yuan
>
> Because LocalDirHandlerService@LocalDirAllocator`s mechanism,they will create
> massive LocalFileSystem.So lead to heap leak.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
