Peter, One thing that changed is the default number of entries we keep in the write ahead logs that went from 100 000 to 100 mainly because we wanted to be safe in the case of 1MB rows. This can easily slow down the inserts a lot. To be sure, try resetting hbase.regionserver.flushlogentries to 100 in hbase-site.xml and restart HBase.
J-D On Mon, Nov 9, 2009 at 10:23 AM, Peter Rietzler <[email protected]> wrote: > > Hi > > We currently switch from HBase 0.19.3 to 0.20.1 and experience very slow > inserts in comparison to 0.19.3. > > Inserting 10.000 rows with around 100 columns (pretty small content) per row > takes around 26 seconds. I am using HTable.put(List<Row>) with batches of > 1000 rows. I've already set HTable.setAutoCommit(false) and tried to set the > write buffer size to around 12MB (as seen in some previous posts). > > Our test currently just uses a standalone instance of HBase. With 0.19.3 the > insert took a couple of seconds (using BatchUpdate). > > Can someone tell me what I'm doing wrong ? > > Thanks in advance! > > Cheers, > Peter > -- > View this message in context: > http://old.nabble.com/HTable.put%28%29-with-Hbase-0.20.1-tp26271241p26271241.html > Sent from the HBase User mailing list archive at Nabble.com. > >
