Hi Stack Thanks for your reply. As per the logs not many Store files for META only 1 HFile for META. We are carrying out different tests. Any ideas are welcome!!
Regards Ram -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Stack Sent: Wednesday, January 25, 2012 11:35 AM To: [email protected] Subject: Re: CatalogJanitor trying to delete an already deleted region from META On Tue, Jan 24, 2012 at 8:44 PM, Ramkrishna.S.Vasudevan <[email protected]> wrote: > The region 9e28c97ccec104f3174ecf343cb59157 is a parent region. It got > splitted into 2 daughter regions. > > The CatalogJanitor deleted this entry from META. Subsequent run of Catalog > Janitor did not find the deleted region from META. After 5 times of > CatalogJanitor running, it again found the deleted region. > Thats odd Ram. > Anyway this time as the region was deleted from HDFS we got the below warn > log. > > > 2012-01-13 07:46:49,552 WARN org.apache.hadoop.hbase.regionserver.HRegion: > Failed delete of > hdfs://193.195.18.121:9000/hbase/Htable_UFDR_037/9e28c97ccec104f3174ecf343cb > 59157 > > But why did the CatalogJanitor again pick up this deleted region in META. > fullScan(). The same scenario has happened for about 6 regions in the same > time. From the RS logs we could not find any operation pertaining to this > region during that time. > > Any clues or suggestions? > In old days, back before 0.20 IIRC, we had an issue where edits could resurface in .META. because we were doing the merge of deletes and edits from different store files 'wrong'. A full-compaction would 'fix it'. Were there many storefiles in .META. at the time? Maybe something similar (You'd have thought we'd have seen this more frequently if it were the case that we still had this 'bug'). St.Ack
