I'll try this out when I get a chance. Probably not until the weekend. This looks great.
- Andy > From: Kannan Muthukkaruppan <[email protected]> > Subject: RE: HDFS-895 hflush speedup > To: "[email protected]" <[email protected]> > Date: Thursday, April 15, 2010, 10:51 AM > Todd: Good stuff! Have you tried this > out on a HBase test too? > > > I think with it on, we can practically turn off group > > commit and get quite a bit speedup. > > Will batching now happen underneath the DFSClient > automatically now that syncs/appends are not serialized. > > regards, > Kannan > -----Original Message----- > From: Todd Lipcon [mailto:[email protected]] > Sent: Thursday, April 15, 2010 1:59 AM > To: [email protected] > Subject: HDFS-895 hflush speedup > > Any of you out there who are running the 0.20+200+etc > hadoop with 0.20 branch hbase want to try this patch? > I think with it on, we can practically > turn off group commit and get quite a bit speedup. > > -- > Todd Lipcon > Software Engineer, Cloudera
