[
https://issues.apache.org/jira/browse/HIVE-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15304219#comment-15304219
]
Naveen Gangam commented on HIVE-13749:
--------------------------------------
The retained size for each Configuration instance is roughly 100KB. ~66k
instances x ~100KB ~= 6+GB. Thats what we are trying to address.
[~thejas] We have seen several issues around HMS stability (sudden death
crashes) in the past, a good % of them were OOMs, some connections leaks, some
incorrectly sized thread pools etc. We have asked customers to increase the max
memory for the HMS process. Some customers running with 40GB memory for HMS and
that too at times is not enough. 16GB to 24GB is quite common amongst other
customers too.
In the past, we have not received heap dumps from the process prior to the
crash. So we did not get a chance to analyze it.
> Memory leak in Hive Metastore
> -----------------------------
>
> Key: HIVE-13749
> URL: https://issues.apache.org/jira/browse/HIVE-13749
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 1.1.0
> Reporter: Naveen Gangam
> Assignee: Naveen Gangam
> Attachments: HIVE-13749.patch, Top_Consumers7.html
>
>
> Looking a heap dump of 10GB, a large number of Configuration objects(> 66k
> instances) are being retained. These objects along with its retained set is
> occupying about 95% of the heap space. This leads to HMS crashes every few
> days.
> I will attach an exported snapshot from the eclipse MAT.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
