This problem was related to this:
2010-10-25 08:13:00,933 DEBUG
org.apache.hadoop.hbase.master.LoadBalancer: Skipping load balancing.
servers=2 regions=5073 average=2536.5 mostloaded=2537 leastloaded=2537
2010-10-25 08:13:01,690 WARN
org.apache.hadoop.hbase.master.CatalogJanitor: REGIONINFO_QUALIFIER is
empty in
keyvalues={ZNANYLEKARZ_CTU,67-w_2010_36_6C8010B775B90B091CA2B04D2CA7CD49,1287059084055.83fda231f456837b4c9316d433bb89bc./info:server/1287909181224/Put/vlen=24,
ZNANY
LEKARZ_CTU,67-w_2010_36_6C8010B775B90B091CA2B04D2CA7CD49,1287059084055.83fda231f456837b4c9316d433bb89bc./info:serverstartcode/1287909181224/Put/vlen=8}
2010-10-25 08:13:01,690 ERROR
org.apache.hadoop.hbase.master.CatalogJanitor: Caught exception
java.lang.NullPointerException
2010-10-25 08:13:24,385 INFO
org.apache.hadoop.hbase.master.ServerManager: regionservers=2,
averageload=2538
because after droping this table problem has gone, Problem with CatalogJanitor
was making problem with (re)starting hbase:
2010-10-23 20:16:17,890 DEBUG
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
Cached location for .META.,,1.1028785192 is
db2a.goldenline.pl:60020
2010-10-23 20:16:18,432 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting
shutdown.
java.lang.NullPointerException
at
org.apache.hadoop.hbase.util.Writables.getWritable(Writables.java:75)
at
org.apache.hadoop.hbase.util.Writables.getHRegionInfo(Writables.java:119)
at
org.apache.hadoop.hbase.client.MetaScanner$1.processRow(MetaScanner.java:188)
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:157)
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:69)
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:54)
at
org.apache.hadoop.hbase.client.MetaScanner.listAllRegions(MetaScanner.java:195)
at
org.apache.hadoop.hbase.master.AssignmentManager.assignAllUserRegions(AssignmentManager.java:1048)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:379)
at
org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:265)
2010-10-23 20:16:18,433 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting
2010-10-23 20:16:18,433 DEBUG org.apache.hadoop.hbase.master.HMaster:
Stopping service threads
I still have access to data with very similar problem.
W dniu 24.10.2010 19:14, Stack pisze:
> Please thread dump the regionserver using 100%. Do it a few times and
> pastebin the result so we can take a look.
> St.Ack
>
> On Sun, Oct 24, 2010 at 1:52 AM, Sebastian Bauer <[email protected]> wrote:
>> Today i try to make some denormalization in my hbase, so i run scaner on
>> one table with day-user counters and ICV to table with
>> week-user,month-user and global-user counters and after about 2 hours
>> program(written in python) raise an exception in scanner because scanner
>> expires, main problem was that hbase running very slow when program
>> making ICV, one region server using 100%, but nothing was putting in
>> logs, any splits, compactions etc..
>>
>> Do you have any ideas what can cause this?
>>
>> Thank you!
>> S.
>>
--
Pozdrawiam
Sebastian Bauer
-----------------------------------------------------
http://tikecik.pl
