Sorry for reply to late~ 2009/11/6 stack <[email protected]>
> For sure all your keys are unique? Write them as output from your job and > count that output too (does the reduce count match the map count)? > St.Ack > > Yes, they are unique, I have just checked it~~ I don't have reduce. Just save records into hbase in the map. But i just did a test , collect all the row keys, and found that the reduce count matches the map count > On Wed, Nov 4, 2009 at 10:30 PM, Eason.Lee <[email protected]> wrote: > > > 0.20.1 > > > > I didn't see any error during upload~~ > > > > and there is no error in logs > > > > 2009/11/5 Jean-Daniel Cryans <[email protected]> > > > > > Which version of HBase? Any region server crash during the upload? > > > > > > J-D > > > > > > On Wed, Nov 4, 2009 at 10:09 PM, Eason.Lee <[email protected]> > wrote: > > > > I have dumped all my data into Hbase using mapreduce > > > > the result shows i have processed 4,413,160 records > > > > But there are only 4217742 rows in the table(count by rowcounter) > > > > > > > > dump: > > > > Map input records 4,413,160 0 4,413,160count: > > > > Map input records 4,217,742 0 4,217,742 > > > > There is no error,and row key is unique( > > > > Math.Random()+"_"+fileName+"_"+currentPosition ) > > > > > > > > > >
