I'd say it's the: 2010-09-27 12:16:15,291 INFO org.apache.hadoop.hbase.regionserver.Store: Started compaction of 943 file(s) in att of img833,dsc03711s.jpg,1285493435306.da57612ee69d7baaefe84 eeb0e49f240. into hdfs://namenode-rd.imageshack.us:9000/hbase/img833/da57612ee69d7baaefe84eeb0e49f240/.tmp, sequenceid=618626242
That killed you. I wonder how it was able to get there since the Memstore blocks flushing if the upper threshold for compactions was reached (default is 7, did you set it to 1000 by any chance?). J-D On Mon, Sep 27, 2010 at 12:29 PM, Jack Levin <[email protected]> wrote: > Strange situation, cold start the cluster, and one of the servers just > started getting more and more consuming of RAM, you can see it form > the screenshot I am attaching. Here is the log: > http://pastebin.com/MDPJzLQJ > > There seem to be nothing happen, and then it just runs out of Memory, > and of course shuts down. > > Here is GC log before the crash: http://pastebin.com/GwdC3nhx > > Strange , that other region servers stay up and consuming little > memory (or rather stay stable.). > > Any ideas? > > -Jack >
