[
https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915598#comment-16915598
]
Tao Yang edited comment on YARN-9714 at 8/26/19 8:45 AM:
---------------------------------------------------------
Hi, [~rohithsharma].
I have commented (over
[here|https://issues.apache.org/jira/browse/YARN-9714?focusedCommentId=16896704&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16896704])
for this: "As for zkManager in ZKStateStore, it will reuse zkManager for HA
when RM uses the Curator-based elector for leader election, otherwise it will
be created for ZKRMStateStore". Please refer to
{{ResourceManager#createEmbeddedElector}} and {{ZKRMStateStore#initInternal}}
for details.
was (Author: tao yang):
Hi, [~rohithsharma].
I have commented (over here) for this: "As for zkManager in ZKStateStore, it
will reuse zkManager for HA when RM uses the Curator-based elector for leader
election, otherwise it will be created for ZKRMStateStore". Please refer to
{{ResourceManager#createEmbeddedElector}} and {{ZKRMStateStore#initInternal}}
for details.
> ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby
> -----------------------------------------------------------------------------
>
> Key: YARN-9714
> URL: https://issues.apache.org/jira/browse/YARN-9714
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Reporter: Tao Yang
> Assignee: Tao Yang
> Priority: Major
> Labels: memory-leak
> Attachments: YARN-9714.001.patch, YARN-9714.002.patch
>
>
> Recently RM full GC happened in one of our clusters, after investigating the
> dump memory and jstack, I found two places in RM may cause memory leaks after
> RM transitioned to standby:
> # Release cache cleanup timer in AbstractYarnScheduler never be canceled.
> # ZooKeeper connection in ZKRMStateStore never be closed.
> To solve those leaks, we should close the connection or cancel the timer when
> services are stopping.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
