[
https://issues.apache.org/jira/browse/HIVE-24711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277146#comment-17277146
]
Karen Coppage commented on HIVE-24711:
--------------------------------------
That error looks like it is from PartitionManagementTask (which runs if
metastore.housekeeping.threads.on=true and metastore.task.threads.remote
contains "org.apache.hadoop.hive.metastore.PartitionManagementTask"), not the
compactor.Initiator.
Do you see any doas errors like that from compactor.Initiator?
> hive metastore memory leak
> --------------------------
>
> Key: HIVE-24711
> URL: https://issues.apache.org/jira/browse/HIVE-24711
> Project: Hive
> Issue Type: Bug
> Components: Hive, Metastore
> Affects Versions: 3.1.0
> Reporter: LinZhongwei
> Priority: Major
>
> hdp version:3.1.5.31-1
> hive version:3.1.0.3.1.5.31-1
> hadoop version:3.1.1.3.1.5.31-1
> We find that the hive metastore has memory leak if we set
> compactor.initiator.on to true.
> If we disable the configuration, the memory leak disappear.
> How can we resolve this problem?
> Even if we set the heap size of hive metastore to 40 GB, after 1 month the
> hive metastore service will be down with outofmemory.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)