[
https://issues.apache.org/jira/browse/HBASE-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744072#comment-13744072
]
Anoop Sam John commented on HBASE-5349:
---------------------------------------
Subtask identified as of now
1. Support MemstoreFLush listener
Listeners should be able to be registered. When the flush happens, the
listeners should get notified. The notification may include on which region the
flush happened and the flush type. The types can be like whether a normal flush
or a flush due to global pressure (unblocked or blocked)
2. Support resizable BlockCache
Resizing can be supported for all BlockCache types which are on heap
cache. LRUBlockCache is onheap type. Also DoubleBlockCache having onheap
LRUCache along with off heap cache. So DoubleBlockCache also can be resizable.
3. Support specifying global memstore lower watermark as a % of global memstore
upper limit
Now memstore lower watermark is specified as a % of the max heap size
and defaults to 38%.(Default upper water mark memstore size is 40%) We need to
change this behavior so as to specify lower water mark as a % of the upper
water mark limit. (The default can be 95% (ie. 0.38/0.4 * 100)
4. Support size range for memstore size and block cache size
Support min and max values for memstore size and block cache size. The
auto tuner can adjust the cache size to a value in btw these ranges.
5. Support pluggable auto tuner
There should be an interface based auto tuner impl. Configuring the
FQCN of the impl in hbase-site.xml allows user to provide a custom impl for the
auto tuner. Also provide a default impl which will decide the cache sizes based
on the memstore flushes (due to global heap pressure) and block cache evictions
6. Support turn ON/OFF the memory tuner at run time.
> Automagically tweak global memstore and block cache sizes based on workload
> ---------------------------------------------------------------------------
>
> Key: HBASE-5349
> URL: https://issues.apache.org/jira/browse/HBASE-5349
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.0
> Reporter: Jean-Daniel Cryans
> Assignee: Anoop Sam John
>
> Hypertable does a neat thing where it changes the size given to the CellCache
> (our MemStores) and Block Cache based on the workload. If you need an image,
> scroll down at the bottom of this link:
> http://www.hypertable.com/documentation/architecture/
> That'd be one less thing to configure.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira