[
https://issues.apache.org/jira/browse/HIVE-25672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17481265#comment-17481265
]
Zoltan Haindrich commented on HIVE-25672:
-----------------------------------------
I tried to reproduce this issue; at first metastore.compactor.initiator.on was
disabled on my cluster for some reason; but after turning that on things
started working correctly:
* a metastore with 52M of heap was able to cleanup 10K of records in no time
** and was OOM-ed for 100K
* a metastore with 966K rows in the COMPLETED_COMPACTIONS table
** removed 50773 rows multiple times - and was able to reduce the volume to
below 100 in around a minute
I don't know if we have an issue here - as it seems like that most likely for
some reason either the `AcidHouseKeeperService` is not running - or stopped
running for some reason
> Hive isn't purging older compaction entries from show compaction command
> ------------------------------------------------------------------------
>
> Key: HIVE-25672
> URL: https://issues.apache.org/jira/browse/HIVE-25672
> Project: Hive
> Issue Type: Bug
> Components: Hive, Metastore, Transactions
> Affects Versions: 3.1.1
> Reporter: Rohan Nimmagadda
> Priority: Minor
>
> Added below properties in hive-site, but it's not enforced to auto purging.
> When we run show compaction command it takes forever and returns billions of
> rows.
> Result of show compactions command :
> {code:java}
> 752,450 rows selected (198.066 seconds)
> {code}
> {code:java}
> hive.compactor.history.retention.succeeded": "10",
> "hive.compactor.history.retention.failed": "10",
> "hive.compactor.history.retention.attempted": "10",
> "hive.compactor.history.reaper.interval": "10m" {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
