Re: Help: ROOT and META!!

2012-04-16 Thread Jonathan Hsieh
Arber, Good to hear! Just to confirm, the bug/patch the same as HBASE-5488? Jon. On Sun, Apr 15, 2012 at 4:36 AM, Yabo Xu arber.resea...@gmail.com wrote: Hi Jon: Please ignore my last email. We found it was a bug, fix it by a patch and rebuild, and it works now. Data are back! Thanks.

Re: Help: ROOT and META!!

2012-04-16 Thread Yabo Xu
Yes, it is. Thanks. Best, Arber On Tue, Apr 17, 2012 at 12:05 AM, Jonathan Hsieh j...@cloudera.com wrote: Arber, Good to hear! Just to confirm, the bug/patch the same as HBASE-5488? Jon. On Sun, Apr 15, 2012 at 4:36 AM, Yabo Xu arber.resea...@gmail.com wrote: Hi Jon: Please

Re: Help: ROOT and META!!

2012-04-15 Thread Yabo Xu
Hi Jon: Please ignore my last email. We found it was a bug, fix it by a patch and rebuild, and it works now. Data are back! Thanks. Best, Arber On Sun, Apr 15, 2012 at 12:47 PM, Yabo Xu arber.resea...@gmail.com wrote: Dear Jon: We just ran OfflineMetaRepair, while getting the following

Help: ROOT and META!!

2012-04-14 Thread Yabo Xu
Hi all: Just had a desperate nightWe had a small production hbase cluster( 8 nodes), and due to the accident crash of a few nodes, ROOT and META are corrupted, while the rest of tables are mostly there. Are there any way to restore ROOT and META? Any of the hints would be appreciated very

Re: Help: ROOT and META!!

2012-04-14 Thread Jonathan Hsieh
There is a two tools that can try to help you (unfortunately, I haven't written the user documentation for either yet) One is called OfflineMetaRepair. This assumes that hbase is offline reads the data in HDFS to create a new ROOT and new META. If you data is in good shape, this should work

Re: Help: ROOT and META!!

2012-04-14 Thread Yabo Xu
Thanks, St. Ack Jon. To answer St. Ack's question, we are using HBase 0.90.6, and the data corruption happens when some data nodes are lost due to the power issue. We've tried hbck and it reports that ROOT is not found, and hfsk reports two blocks of ROOT and META are CORUPT status. Jon: We just

Re: Help: ROOT and META!!

2012-04-14 Thread Yabo Xu
Dear Jon: We just ran OfflineMetaRepair, while getting the following exceptions. Checked online...it seems that is bug. Any suggestions on how to check out the most-updated version of OfflineMetaRepair to work with our version of HBase? Thanks in advance. 12/04/15 12:28:35 INFO util.HBaseFsck: