Hi, One of our region servers keeps doing the following - it has only just started doing this since 40 minutes ago. Our clients are able to get data from hBase, but after a short while, threads lock up and they start waiting indefinitely for data to be returned. What is wrong? - What do we do? - I am desperate, please help as quick as you can.
Regards, Seraph 2010-11-09 23:49:59,102 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:49:59,159 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:49:59,224 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:49:59,226 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:00,269 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:00,730 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:01,157 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:06,916 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:06,917 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:06,917 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:06,918 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:09,106 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:09,106 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:18,271 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:20,924 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:23,151 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:33,792 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:33,793 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:44,161 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:52,489 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:50:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=25.640144MB (26885640), Free=382.29736MB (400867832), Max=407.9375MB (427753472), Counts: Blocks=1493, Access=31181, Hit=28954, Miss=2227, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.85783171653748%, Miss Ratio=7.142169773578644%, Evicted/Run=NaN 2010-11-09 23:50:57,996 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:51:31,922 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:51:31,923 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:51:31,924 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:51:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=28.028427MB (29389936), Free=379.90906MB (398363536), Max=407.9375MB (427753472), Counts: Blocks=1531, Access=31277, Hit=29008, Miss=2269, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.74546504020691%, Miss Ratio=7.254531979560852%, Evicted/Run=NaN 2010-11-09 23:52:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=31.233871MB (32751088), Free=376.7036MB (395002384), Max=407.9375MB (427753472), Counts: Blocks=1582, Access=31483, Hit=29168, Miss=2315, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.64682531356812%, Miss Ratio=7.353174686431885%, Evicted/Run=NaN 2010-11-09 23:53:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=34.532898MB (36210368), Free=373.4046MB (391543104), Max=407.9375MB (427753472), Counts: Blocks=1635, Access=31612, Hit=29246, Miss=2366, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.5154983997345%, Miss Ratio=7.484499365091324%, Evicted/Run=NaN 2010-11-09 23:54:21,831 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:54:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=37.375MB (39190528), Free=370.5625MB (388562944), Max=407.9375MB (427753472), Counts: Blocks=1681, Access=31761, Hit=29344, Miss=2417, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.39003658294678%, Miss Ratio=7.609961926937103%, Evicted/Run=NaN 2010-11-09 23:55:45,289 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:55:45,289 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:55:48,079 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2010-11-09 23:55:57,903 DEBUG org.apache.hadoop.hbase.io.hfile.LruBlockCache: Cache Stats: Sizes: Total=40.266388MB (42222368), Free=367.6711MB (385531104), Max=407.9375MB (427753472), Counts: Blocks=1728, Access=33834, Hit=31364, Miss=2470, Evictions=0, Evicted=0, Ratios: Hit Ratio=92.69965291023254%, Miss Ratio=7.300348579883575%, Evicted/Run=NaN
