On Thu, Apr 23, 2009 at 2:53 AM, Cosmin Lehene <[email protected]> wrote:
> Hi, > > Is there any way to rebuild the .META. Table with information in HDFS? > There is not enough info in HDFS to fixup .META. Directory names are encodings of regionname. There is not a means of going from the encoding to original. Even then, you'd need to get the HRegionInfo from somewhere. Currently its only in .META. HRegionInfo has vitals like start and end key, whether region was offlined. That rebuild of .META. is not possible using the persisted info is a glaring omission on our part. We have an issue for an hbase fsck tool but its not done yet. If only you had a listing of the .META. content from a time close to the fillup. In not too recent past I had such a thing and parsed it repairing a mangled table rename where a script of mine went awry. What version of hbase Cosmin? In 0.18.x, if at DEBUG level, we'd dump content of .META. tables to the log. Was turned off in 0.19.x though. Now we just log changes. Maybe it be possible to parse the master log to extract all changes and use this as a source to help repair .META.? (I just took a look, I don't think there is enough info there -- I'll make an issue). St.Ack > > Long story short, the namenode ran out of disk and crashed and we couldn't > have it load the edits.new file at startup (the edits.new file seemed > corrupted and it failed to read some Long value) so we removed the > edits.new > file. Apparently the edits file had 10 - 15 entries. Some edit data on > -ROOT-, some edit data on .META., some data on a table compaction > (comapction.dir) and some data on some hbase logs. Only last entry seem to > be bogus, having almost a megabyte of trailing zeroes. > > After renaming edits.new HDFS started ok and HBase data is present. However > when we started Hbase one table was missing entirely and one table was > empty. The HBase master report shows Regions On FS: 94, but the report on > region servers shows only 10 regions on all the region servers. > > Is there any way to cleanup hbase and rebuild the .META. table from HDFS? > This would be ok even if it implies throwing up some data. > > If we would clean the edits.new file and restart HDFS or if we would > manually apply the edits would that still make consistent changes to HBase > data? > > Thanks, > Cosmin > >
