653 regions is very low, even if you had a total of 3 region servers I wouldn't expect any problem.
So to me it seems to point towards either a configuration issue or a usage issue. Can you: - Put the log of one region server that OOMEd on a public server. - Tell us more about your setup: # of nodes, hardware, configuration file - Tell us more about how you insert data into HBase And BTW are you trying to do an initial import of your data set? If so, have you considered using HFileOutputFormat? Thx, J-D On Thu, Jul 1, 2010 at 11:52 AM, Jinsong Hu <[email protected]> wrote: > Hi, Sir: > I am using hbase 0.20.5 and this morning I found that 3 of my region > server running out of memory. > the regionserver is given 6G memory each, and on average, I have 653 regions > in total. max store size > is 256M. I analyzed the dump and it shows that there are too many HRegion in > memory. > > Previously set max store size to 2G, but then I found the region server > constantly does minor compaction and the CPU usage is very high, It also > blocks the heavy client record insertion. > > So now I am limited on one side by memory, limited on another size by CPU. > Is there anyway to get out of this dilemma ? > > Jimmy. >
