Hi all,
I have been trying to play with Hbase in the last few days and hit a snag -
when trying to fill up an Hbase table, via 25 thrift-generated clients (the
injectors) - after a few hours it crashed. After reading through the logs and
in the issue tracker, it sounds just like Hbase-766.
Errors: in the log file I get a bunch of NotServingRegionExceptions:
error: org.apache.hadoop.hbase.NotServingRegionException: Region
test_user,81B09FA2-9A9F-42CD-9D15-D1FE608D39D4,1219115748711 closed.
Also, in the Hbase-hadoop-master log file, I get File does not exists
exceptions, like the one below (but with different row keys).
2008-08-20 02:13:24,135 INFO org.apache.hadoop.hbase.master.ServerManager:
Received MSG_REPORT_CLOSE:
test_user,C8441FEF-2809-4B1B-881A-6CDC5F21BECA,1219127080127:
java.io.FileNotFoundException: File does not exist:
hdfs://192.168.1.101:54310/hbase/test_user/203999734/subscribed_feed/mapfiles/5434845147549741098/data
at
org.apache.hadoop.dfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:369)
at
org.apache.hadoop.hbase.regionserver.HStoreFile.length(HStoreFile.java:444)
at
org.apache.hadoop.hbase.regionserver.HStore.loadHStoreFiles(HStore.java:436)
at org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:218)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1653)
at org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:470)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:902)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:877)
at
org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:817)
at java.lang.Thread.run(Thread.java:619)
from 192.168.1.103:60020
After a few of these the entire cluster (of 5 machines) went down.
I'm using Hbase 0.2.0 and Hadoop 0.1.7.1.
Any ideas?
Thanks,
Cristian Ivascu
