[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937551#comment-15937551 ] Anoop Sam John commented on HBASE-17739: Agree.. BTW we by def wont be keeping compressed

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-22 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936970#comment-15936970 ] Vladimir Rodionov commented on HBASE-17739: --- Do not forget 8-byte padding for small data types.

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936813#comment-15936813 ] Anoop Sam John commented on HBASE-17739: Thanks. Ya I missed some parts like Object size as such

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-21 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935224#comment-15935224 ] Vladimir Rodionov commented on HBASE-17739: --- {quote} What was ur math V? {quote} BucketEntry

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-21 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934137#comment-15934137 ] ramkrishna.s.vasudevan commented on HBASE-17739: bq.The implications are two-fold:

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-20 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934111#comment-15934111 ] Anoop Sam John commented on HBASE-17739: bq.Heap overhead is close to 500 bytes per block. You

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-20 Thread Vladimir Rodionov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933266#comment-15933266 ] Vladimir Rodionov commented on HBASE-17739: --- BucketCache has two major design/implementation

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926136#comment-15926136 ] Anoop Sam John commented on HBASE-17739: Yes. Once we complete the 64 KB bucket slots, we will

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-15 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925985#comment-15925985 ] ramkrishna.s.vasudevan commented on HBASE-17739: AFter reading the code, I think in case

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-13 Thread Janos Gub (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922507#comment-15922507 ] Janos Gub commented on HBASE-17739: --- If there is no bucket of that size we will end up evicting a

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-13 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907743#comment-15907743 ] Anoop Sam John commented on HBASE-17739: One bucket size (Say 8 KB) is there as per the config

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-13 Thread Janos Gub (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907736#comment-15907736 ] Janos Gub commented on HBASE-17739: --- Why is it needed to hold at least one bucket for each size? >

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-13 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907717#comment-15907717 ] Anoop Sam John commented on HBASE-17739: It might help with issue#2 what is mentioned in

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-13 Thread Janos Gub (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907611#comment-15907611 ] Janos Gub commented on HBASE-17739: --- What if instead of the fix number of buckets we set up a bucket

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-07 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900828#comment-15900828 ] Allan Yang commented on HBASE-17739: Here is the Issue

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-07 Thread Allan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900589#comment-15900589 ] Allan Yang commented on HBASE-17739: Right away, Sir! [~zjushch] [~stack] > BucketCache is

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-07 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900583#comment-15900583 ] chunhui shen commented on HBASE-17739: -- It's a feature completed by my teammate [~allan163], he will

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-06 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898786#comment-15898786 ] stack commented on HBASE-17739: --- bq. How about making the encoded blocks have similar size? Tell us more

[jira] [Commented] (HBASE-17739) BucketCache is inefficient/wasteful/dumb in its bucket allocations

2017-03-06 Thread chunhui shen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898603#comment-15898603 ] chunhui shen commented on HBASE-17739: -- How about making the encoded blocks have similar size? In