We have an issue with 0.20.0 where we did a shutdown and a start up and
lost access to the tables.
Is there a tool to repair issues like this? How do we go about fixing
this manually?
Creating a new table while this is occurring seems to be assigned a
region server ok and can be scanned.
The master log reports the following over and over:
2009-09-15 18:17:13,552 INFO
org.apache.hadoop.hbase.master.ServerManager: 28 region servers, 0 dead,
average load 0.10714285714285714
2009-09-15 18:17:13,606 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.metaScanner scanning meta region {server:
10.4.30.37:60020, regionname: .META.,,1, startKey: <>}
2009-09-15 18:17:13,607 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.rootScanner scanning meta region {server:
10.4.30.19:60020, regionname: -ROOT-,,0, startKey: <>}
2009-09-15 18:17:13,615 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.rootScanner scan of 1 row(s) of meta region {server:
10.4.30.19:60020, regionname: -ROOT-,,0, startKey: <>} complete
2009-09-15 18:17:13,633 INFO org.apache.hadoop.hbase.master.BaseScanner:
RegionManager.metaScanner scan of 3 row(s) of meta region {server:
10.4.30.37:60020, regionname: .META.,,1, startKey: <>} complete
2009-09-15 18:17:13,634 INFO org.apache.hadoop.hbase.master.BaseScanner:
All 1 .META. region(s) scanned
2009-09-15 18:17:13,834 INFO
org.apache.hadoop.hbase.master.ServerManager: Processing
MSG_REPORT_CLOSE: dropzone,,1253047705364: java.lang.IllegalAccessError:
Has not been initialized
at
org.apache.hadoop.hbase.regionserver.StoreFile.getMaxSequenceId(StoreFile.java:216)
at
org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:388)
at org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:217)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1505)
at
org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:308)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1601)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1570)
at
org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1485)
at java.lang.Thread.run(Unknown Source)
from hfs-030031,60020,1253063295720; 1 of 1
2009-09-15 18:17:13,834 INFO
org.apache.hadoop.hbase.master.RegionServerOperation: region set as
unassigned: dropzone,,1253047705364
Each region server reports:
2009-09-15 18:18:13,543 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN:
dropzone,,1253047705364
2009-09-15 18:18:13,544 INFO
org.apache.hadoop.hbase.regionserver.HRegionServer: Worker:
MSG_REGION_OPEN: dropzone,,1253047705364
2009-09-15 18:18:13,560 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer: Error opening
dropzone,,1253047705364
java.lang.IllegalAccessError: Has not been initialized
at
org.apache.hadoop.hbase.regionserver.StoreFile.getMaxSequenceId(StoreFile.java:216)
at
org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:388)
at org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:217)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1505)
at
org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:308)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1601)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1570)
at
org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1485)
at java.lang.Thread.run(Unknown Source)