How to avoid stop-the-world GC for HBase Region Server under big heap size

2012-08-23 Thread Gen Liu
Hi, We are running Region Server on big memory machine (70G) and set Xmx=64G. Most heap is used as block cache for random read. Stop-the-world GC is killing the region server, but using less heap (16G) doesn't utilize our machines well. Is there a concurrent or parallel GC option that won't

Re: How to avoid stop-the-world GC for HBase Region Server under big heap size

2012-08-23 Thread J Mohamed Zahoor
Slab cache might help http://www.cloudera.com/blog/2012/01/caching-in-hbase-slabcache/ ./zahoor On Thu, Aug 23, 2012 at 11:36 AM, Gen Liu ge...@zynga.com wrote: Hi, We are running Region Server on big memory machine (70G) and set Xmx=64G. Most heap is used as block cache for random read.

Re: How to avoid stop-the-world GC for HBase Region Server under big heap size

2012-08-23 Thread N Keywal
Hi, For a possible future, there is as well this to monitor: http://docs.oracle.com/javase/7/docs/technotes/guides/vm/G1.html More or less requires JDK 1.7 See HBASE-2039 Cheers, N. On Thu, Aug 23, 2012 at 8:16 AM, J Mohamed Zahoor jmo...@gmail.com wrote: Slab cache might help

Re: How to avoid stop-the-world GC for HBase Region Server under big heap size

2012-08-23 Thread Stack
On Wed, Aug 22, 2012 at 11:06 PM, Gen Liu ge...@zynga.com wrote: Hi, We are running Region Server on big memory machine (70G) and set Xmx=64G. Most heap is used as block cache for random read. Stop-the-world GC is killing the region server, but using less heap (16G) doesn't utilize our