Sheetal Dolas created HBASE-12324:
-------------------------------------
Summary: Improve compaction speed and process for immutable short
lived datasets
Key: HBASE-12324
URL: https://issues.apache.org/jira/browse/HBASE-12324
Project: HBase
Issue Type: New Feature
Components: Compaction
Affects Versions: 0.96.0, 0.98.0
Reporter: Sheetal Dolas
We have seen multiple cases where HBase is used to store immutable data and the
data lives for short period of time (few days)
On very high volume systems, major compactions become very costly and slowdown
ingestion rates.
In all such use cases (immutable data, high write rate and moderate read rates
and shorter ttl), avoiding any compactions and just deleting old data brings
lot of performance benefits.
We should have a compaction policy that can only delete/archive files older
than TTL and not compact any files.
Also attaching a patch that can do so.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)