[
https://issues.apache.org/jira/browse/YARN-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Max Xie updated YARN-10649:
----------------------------
Description:
YARN-5168 the patch added RMNodeImpl.updatedExistContainers, but it didn't
remove completed containers.
These objects (ContainerStatusPBImpl & ContainerIdPBImpl ) stay in
RMNodeImpl.updatedExistContainers forever.
Because of this leak, ResourceManager in our production environment encountered
OOM issue. We found 13 million ContainerStatusPBImpl objects in the heap dump
file of ResourceManager.
The patch has been applied in our production env and so far it works well.
was:
YARN-5168 the patch added RMNodeImpl.updatedExistContainers, but it didn't
remove completed containers.
These objects stay in RMNodeImpl.completedContainers forever.
> ContainerIdPBImpl & ContainerStatusPBImpl objects can be leaked in
> RMNodeImpl.updatedExistContainers
> ----------------------------------------------------------------------------------------------------
>
> Key: YARN-10649
> URL: https://issues.apache.org/jira/browse/YARN-10649
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Affects Versions: 3.3.0
> Reporter: Max Xie
> Assignee: Max Xie
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> YARN-5168 the patch added RMNodeImpl.updatedExistContainers, but it didn't
> remove completed containers.
> These objects (ContainerStatusPBImpl & ContainerIdPBImpl ) stay in
> RMNodeImpl.updatedExistContainers forever.
> Because of this leak, ResourceManager in our production environment
> encountered OOM issue. We found 13 million ContainerStatusPBImpl objects in
> the heap dump file of ResourceManager.
> The patch has been applied in our production env and so far it works well.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
