[
https://issues.apache.org/jira/browse/HBASE-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack updated HBASE-5369:
-------------------------
Component/s: Compaction
BlockCache
> Compaction selection based on the hotness of the HFile's block in the block
> cache
> ---------------------------------------------------------------------------------
>
> Key: HBASE-5369
> URL: https://issues.apache.org/jira/browse/HBASE-5369
> Project: HBase
> Issue Type: Improvement
> Components: BlockCache, Compaction
> Reporter: Liyin Tang
> Assignee: Liyin Tang
>
> HBase reserves a large set memory for the block cache and the cached blocks
> will be age out in a LRU fashion. Obviously, we don't want to age out the
> blocks which are still hot. However, when the compactions are starting, these
> hot blocks may naturally be invalid. Considering that the block cache has
> already known which HFiles these hot blocks come from, the compaction
> selection algorithm could just simply skip compact these HFiles until these
> block cache become cold.
> For example, if there is a HFile and 80% of blocks for this HFile is be
> cached, which means this HFile is really hot, then just skip this HFile
> during the compaction selection.
> The percentage of hot blocks should be configured as a high bar to make sure
> that HBase are still making progress for the compaction.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
