Thanks for the responses. I am using 0.90.4-cdh3. i exported the table using hbase exporter. Yes, the previous table still exists but on a different cluster.My region servers are large, close to 12GB in size.
I want to understand regarding Hfiles. We export the table as a series of Hfiles and then import them in? What is the difference between that in the regular MR export job? I idea sounds good because it sounds simple on the surface :-) On Fri, Mar 30, 2012 at 12:08 AM, Stack <[email protected]> wrote: > On Thu, Mar 29, 2012 at 7:57 PM, Rita <[email protected]> wrote: > > Hello, > > > > I am importing a 40+ billion row table which I exported several months > ago. > > The data size is close to 18TB on hdfs (3x replication). > > > > Does the table from back then still exist? Or do you remember what > the key spread was like? Could you precreate the old table? > > > My problem is when I try to import it with mapreduce it takes a few days > -- > > which is ok -- however when the job fails to whatever reason, I have to > > restart everything. Is it possible to import the table in chunks like, > > import 1/3, 2/3, and then finally 3/3 of the table? > > > > Yeah. Funny how the plug gets pulled on the rack when the three day > job is at the end 95% done. > > > Btw, the jobs creates close to 150k mapper jobs, thats a problem waiting > to > > happen :-) > > > > Are you running 0.92? If not, you should and go for bigger regions. 10G? > > St.Ack > -- --- Get your facts first, then you can distort them as you please.--
