Bryan Beaudreault created HBASE-28111:
-----------------------------------------
Summary: Compaction queue should dedupe or consolidate queued
requests
Key: HBASE-28111
URL: https://issues.apache.org/jira/browse/HBASE-28111
Project: HBase
Issue Type: Improvement
Reporter: Bryan Beaudreault
We had a compaction storm due to a huge bulkload. We ended up in a state where
each regionserver had hundreds of compactions queued, despite only serving <
100 regions each. As writes continued, flushes happened, triggering minor
compactions that got added to the queue as well. This results in a situation
where we can never catch up on compactions because we keep compacting the same
regions over and over.
It would be good if the compaction queue could automatically consolidate or
deduplicate requests. For example, if a region has 5 compactions queued, just
run 1 major compaction and clear the other 5 from the queue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
