What does hbase hbck say? (http://hbase.apache.org/book.html#hbck).
What does the master log have in it? Anything of interest. St.Ack On Mon, May 23, 2011 at 7:53 AM, Himanish Kushary <[email protected]> wrote: > Pressed the send button too soon... > > Also here is the output from hadoop fsck > > *Status: HEALTHY* > * Total size: 37678848280 B* > * Total dirs: 941* > * Total files: 902 (Files currently being written: 1)* > * Total blocks (validated): 1141 (avg. block size 33022654 B) (Total open > file blocks (not validated): 1)* > * Minimally replicated blocks: 1141 (100.0 %)* > * Over-replicated blocks: 0 (0.0 %)* > * Under-replicated blocks: 906 (79.40403 %)* > * Mis-replicated blocks: 0 (0.0 %)* > * Default replication factor: 2* > * Average block replication: 2.0* > * Corrupt blocks: 0* > * Missing replicas: 1886 (82.646805 %)* > * Number of data-nodes: 2* > * Number of racks: 1* > *FSCK ended at Mon May 23 10:51:13 EDT 2011 in 257 milliseconds* > * > * > * > * > *The filesystem under path '/' is HEALTHY* > > > Could anybody please help on how to recover from this scenario . > > Thanks > > > On Mon, May 23, 2011 at 10:50 AM, Himanish Kushary <[email protected]>wrote: > >> Hi, >> >> Our hbase/hadoop servers machines were shutdown without bringing the hadoop >> and hbase services down properly.Now when we try to bring up hbase we get >> the following error in the master log: >> >> org.apache.hadoop.hbase.NotServingRegionException: Region is not online: >> -ROOT-,,0 >> >> Hadoop services (namenode,jobtracker,datanode etc) have come up properly >> and we are able to see the files in HDFS. But HBase Master keeps on throwing >> this exception and then finally throws a Java Heap Space error. >> >> Note: We have two datanodes, replication set to 2 and around 900 blocks are >> shown as under-replicated. >> >> --------------------------------- >> Thanks & Regards >> Himanish >> > > > > -- > Thanks & Regards > Himanish >
