Hi, There:
I am using cloudera cdh3 regionserver and today, I noticed that one of the
regionserver memory usage is very high:
request=8.8, regions=60, stores=61, storefiles=67, storefileIndexSize=142,
memstoreSize=58, compactionQueueSize=0, usedHeap=5869, maxHeap=6127,
blockCacheSize=1061944288, blockCacheFree=223059360, blockCacheCount=16239,
blockCacheHitRatio=14
this shows that only 60 regions calused close to 6G of memory usage. This is
very high.
the gc-hbase.log shows:
1461575.642: [GC 1461575.643: [ParNew: 143538K->17024K(153344K), 0.0487050
secs]
5948479K->5846957K(6274432K) icms_dc=0 , 0.0488210 secs] [Times: user=0.33
sys=
0.00, real=0.05 secs]
1461693.726: [GC 1461693.726: [ParNew: 153344K->17024K(153344K), 0.0454440
secs]
5983277K->5875331K(6274432K) icms_dc=0 , 0.0455680 secs] [Times: user=0.31
sys=
0.01, real=0.05 secs]
This shows that the regionserver is indeed using 6G of memory. very close to
the setting of -Xmx6G limit.
and very soon the regionserver will be OOME.
if the above holds true, that means a regionserver can only support around
60 regions. I configured the region size to be default 256M.
I checked the load on the server and the load is very light. cpu and disk
usage is very low. What can I do to drastically increase the number of
regions
supported per regionserver in hbase ?
Jimmy
