I had a similiar case with 0.17 where adding a delay between hadoop startup and hbase startup helped (essentially waiting for hadoop to get out of safe mode, I think) . however when I last tried to restart 0.18 I got the same mesage as you - I did not try yet with delay.
Michael Dagaev wrote: > > Hi, all > > After Hbase (0.18.1) restart our client failed with an IO > Exception -- Could not obtain block: blk_-6097614652807114983_50488 > file=/hbase/-ROOT-/70236052/info/mapfiles/6743958588342007607/data. > (see the full trace below). The hbase shell failed with an exception > too. > > Do you know what can be the root cause of the exception? > > Thank you for your cooperation, > M. > > P.S. The exception stack: > > Caused by: java.io.IOException: java.io.IOException: Could not obtain > block: blk_-6097614652807114983_50488 > file=/hbase/-ROOT-/70236052/info/mapfiles/6743958588342007607/data > at > org.apache.hadoop.dfs.DFSClient$DFSInputStream.chooseDataNode(DFSClient.java:1462) > at > org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:1312) > at > org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:1417) > at > org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:1369) > at java.io.DataInputStream.readInt(DataInputStream.java:370) > at > org.apache.hadoop.io.SequenceFile$Reader.readRecordLength(SequenceFile.java:1898) > at > org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1928) > at > org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1833) > at > org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1879) > at org.apache.hadoop.io.MapFile$Reader.next(MapFile.java:516) > at > org.apache.hadoop.hbase.regionserver.HStore.rowAtOrBeforeFromMapFile(HStore.java:1504) > at > org.apache.hadoop.hbase.regionserver.HStore.getRowKeyAtOrBefore(HStore.java:1476) > at > org.apache.hadoop.hbase.regionserver.HRegion.getClosestRowBefore(HRegion.java:1250) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.getClosestRowBefore(HRegionServer.java:1062) > at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:554) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888) > > -- View this message in context: http://www.nabble.com/Hbase-Client-Failure-tp20913340p20913975.html Sent from the HBase User mailing list archive at Nabble.com.
