[ 
https://issues.apache.org/jira/browse/HBASE-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744072#comment-13744072
 ] 

Anoop Sam John commented on HBASE-5349:
---------------------------------------

Subtask identified as of now
1. Support MemstoreFLush listener
        Listeners should be able to be registered. When the flush happens, the 
listeners should get notified. The notification may include on which region the 
flush happened and the flush type. The types can be like whether a normal flush 
or a flush due to global pressure (unblocked or blocked)

2. Support resizable BlockCache
        Resizing can be supported for all BlockCache types which are on heap 
cache. LRUBlockCache is onheap type. Also DoubleBlockCache having onheap 
LRUCache along with off heap cache. So DoubleBlockCache also can be resizable.

3. Support specifying global memstore lower watermark as a % of global memstore 
upper limit
        Now memstore lower watermark is specified as a % of the max heap size 
and defaults to 38%.(Default upper water mark memstore size is 40%) We need to 
change this behavior so as to specify lower water mark as a % of the upper 
water mark limit. (The default can be 95% (ie. 0.38/0.4 * 100)

4. Support size range for memstore size and block cache size
        Support min and max values for memstore size and block cache size. The 
auto tuner can adjust the cache size to a value in btw these ranges.

5. Support pluggable auto tuner
        There should be an interface based auto tuner impl. Configuring the 
FQCN of the impl in hbase-site.xml allows user to provide a custom impl for the 
auto tuner. Also provide a default impl which will decide the cache sizes based 
on the memstore flushes (due to global heap pressure) and block cache evictions

6. Support turn ON/OFF the memory tuner at run time.

                
> Automagically tweak global memstore and block cache sizes based on workload
> ---------------------------------------------------------------------------
>
>                 Key: HBASE-5349
>                 URL: https://issues.apache.org/jira/browse/HBASE-5349
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 0.92.0
>            Reporter: Jean-Daniel Cryans
>            Assignee: Anoop Sam John
>
> Hypertable does a neat thing where it changes the size given to the CellCache 
> (our MemStores) and Block Cache based on the workload. If you need an image, 
> scroll down at the bottom of this link: 
> http://www.hypertable.com/documentation/architecture/
> That'd be one less thing to configure.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to