[
https://issues.apache.org/jira/browse/HIVE-13749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302889#comment-15302889
]
Naveen Gangam commented on HIVE-13749:
--------------------------------------
perhaps in the HiveMetaStore.shutdown() we clear the cache for the current UGI.
Make sense? Could you please review the patch when you have a chance ?
I have had the customer disable the FileSystem caching by adding
{{fs.hdfs.impl.disable.cache=true}} to the HMS configuration, the re-run the
workloads. The same site that had 66000+ Configuration instances in their
heapdump now has 80 instances and none of them are in Cache. So it is clear
that the FileSystem.CACHE is the problem.
Thanks
> Memory leak in Hive Metastore
> -----------------------------
>
> Key: HIVE-13749
> URL: https://issues.apache.org/jira/browse/HIVE-13749
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 1.1.0
> Reporter: Naveen Gangam
> Assignee: Naveen Gangam
> Attachments: Top_Consumers7.html
>
>
> Looking a heap dump of 10GB, a large number of Configuration objects(> 66k
> instances) are being retained. These objects along with its retained set is
> occupying about 95% of the heap space. This leads to HMS crashes every few
> days.
> I will attach an exported snapshot from the eclipse MAT.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
