On Mon, Oct 25, 2010 at 1:06 PM, Sebastian Bauer <[email protected]> wrote: > This problem was related to this: > > 2010-10-25 08:13:00,933 DEBUG > org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing. > servers=2 regions=5073 average=2536.5 mostloaded=2537 leastloaded=2537 > 2010-10-25 08:13:01,690 WARN > org.apache.hadoop.hbase.master.CatalogJanitor: REGIONINFO_QUALIFIER is > empty in > keyvalues={ZNANYLEKARZ_CTU,67-w_2010_36_6C8010B775B90B091CA2B04D2CA7CD49,1287059084055.83fda231f456837b4c9316d433bb89bc./info:server/1287909181224/Put/vlen=24, > ZNANY > LEKARZ_CTU,67-w_2010_36_6C8010B775B90B091CA2B04D2CA7CD49,1287059084055.83fda231f456837b4c9316d433bb89bc./info:serverstartcode/1287909181224/Put/vlen=8} >
Seems like same null regioninfo issue Sebastien. See below. > 2010-10-25 08:13:01,690 ERROR > org.apache.hadoop.hbase.master.CatalogJanitor: Caught exception > java.lang.NullPointerException > 2010-10-25 08:13:24,385 INFO > org.apache.hadoop.hbase.master.ServerManager: regionservers=2, > averageload=2538 > You have 2500 regions on two servers Sebastien? > > because after droping this table problem has gone, Problem with > CatalogJanitor was making problem with (re)starting hbase: > > 2010-10-23 20:16:17,890 DEBUG > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation: > Cached location for .META.,,1.1028785192 is > db2a.goldenline.pl:60020 > 2010-10-23 20:16:18,432 FATAL org.apache.hadoop.hbase.master.HMaster: > Unhandled exception. Starting > shutdown. > > java.lang.NullPointerException > > at > org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:75) > > at > org.apache.hadoop.hbase.util.Writables.getHRegionInfo(Writables.java:119) > > at > org.apache.hadoop.hbase.client.MetaScanner$1.processRow(MetaScanner.java:188) > > at > org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:157) > > at > org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:69) > > at > org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:54) > > at > org.apache.hadoop.hbase.client.MetaScanner.listAllRegions(MetaScanner.java:195) > > at > org.apache.hadoop.hbase.master.AssignmentManager.assignAllUserRegions(AssignmentManager.java:1048) > > at > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:379) > > at > org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:265) > > 2010-10-23 20:16:18,433 INFO org.apache.hadoop.hbase.master.HMaster: > Aborting > > 2010-10-23 20:16:18,433 DEBUG org.apache.hadoop.hbase.master.HMaster: > Stopping service threads > > > I still have access to data with very similar problem. > Sorry, I don't follow? Its not starting for you still? I made https://issues.apache.org/jira/browse/HBASE-3151 to cover the NPE. Can you fill into the issue the version of hbase you are running (Is it TRUNK)? Thanks, St.Ack > > > W dniu 24.10.2010 19:14, Stack pisze: >> Please thread dump the regionserver using 100%. Do it a few times and >> pastebin the result so we can take a look. >> St.Ack >> >> On Sun, Oct 24, 2010 at 1:52 AM, Sebastian Bauer <[email protected]> wrote: >>> Today i try to make some denormalization in my hbase, so i run scaner on >>> one table with day-user counters and ICV to table with >>> week-user,month-user and global-user counters and after about 2 hours >>> program(written in python) raise an exception in scanner because scanner >>> expires, main problem was that hbase running very slow when program >>> making ICV, one region server using 100%, but nothing was putting in >>> logs, any splits, compactions etc.. >>> >>> Do you have any ideas what can cause this? >>> >>> Thank you! >>> S. >>> > > > -- > > Pozdrawiam > Sebastian Bauer > ----------------------------------------------------- > http://tikecik.pl > >
