RE: heap memory allocation

2011-04-15 Thread Doug Meil
; hbase-u...@hadoop.apache.org Subject: Re: heap memory allocation On Thu, Apr 14, 2011 at 9:50 PM, 陈加俊 cjjvict...@gmail.com wrote: How does heap memory allocated in regionserver ? Metrics: request=0.0, regions=1283, stores=2304, storefiles=1968, storefileIndexSize=246, memstoreSize=791

Re: heap memory allocation

2011-04-15 Thread Matt Corgan
/book.html#hbase_metrics -Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Friday, April 15, 2011 5:04 AM To: user@hbase.apache.org Cc: 陈加俊; hbase-u...@hadoop.apache.org Subject: Re: heap memory allocation On Thu, Apr 14, 2011 at 9:50 PM

Re: heap memory allocation

2011-04-15 Thread Jean-Daniel Cryans
-Original Message- From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack Sent: Friday, April 15, 2011 5:04 AM To: user@hbase.apache.org Cc: 陈加俊; hbase-u...@hadoop.apache.org Subject: Re: heap memory allocation On Thu, Apr 14, 2011 at 9:50 PM, 陈加俊 cjjvict...@gmail.com wrote

Re: heap memory allocation

2011-04-15 Thread Stack
On Fri, Apr 15, 2011 at 8:23 AM, Matt Corgan mcor...@hotpads.com wrote: Some of our servers have 5.2gb hbase heaps with the standard 40% (2gb) memstore and 20% (1gb) blockcache.  I'm wondering where the indexes and bloom filters get counted.  Is it in that remaining 2gb, and are the bloom

Re: heap memory allocation

2011-04-15 Thread Matt Corgan
J-D - yes, I think that increasing block size by 4x would cut the index size by 4x, assuming 1 index entry per block. Random reads are not as important for this table, and tend to cache well. I guess that on the flip-side, scans might be faster. If I start to see problems, I guess my other