Re: Does HBase combine multiple Puts against the same region server?

2012-12-07 Thread daidon...@gmail.com
Hi, Yun Code in HConnectionManager.java, method: submit(ListActionR actionList, ...). It will combine all actions towards the same rs, and send them together... - Dong 在 2012-12-7,上午2:34, yun peng 写道: Hi, I have question on how the multiple Puts() are executed when they are issued against

Does HBase combine multiple Puts against the same region server?

2012-12-06 Thread yun peng
Hi, I have question on how the multiple Puts() are executed when they are issued against the same region server. For example, in the case of asynchronous executing Put() using setAutoFlush(true), there will be multiple Puts() in the writeBuffer. Or use HTbale API put(List puts) which directly

Re: Does HBase combine multiple Puts against the same region server?

2012-12-06 Thread Jimmy Xiang
If auto flush is off, multiple puts could be combined into a batch and send to the region server in one RPC call if they are for the same region server. Thanks, Jimmy On Thu, Dec 6, 2012 at 10:34 AM, yun peng pengyunm...@gmail.com wrote: Hi, I have question on how the multiple Puts() are

Re: Does HBase combine multiple Puts against the same region server?

2012-12-06 Thread yun peng
Is that done in current HBase implementation (say, 0.94.2 or more recent one) or it requires applications to handle it? Thanks for your note, Yun On Thu, Dec 6, 2012 at 1:42 PM, Jimmy Xiang jxi...@cloudera.com wrote: If auto flush is off, multiple puts could be combined into a batch and send

Re: Does HBase combine multiple Puts against the same region server?

2012-12-06 Thread Jimmy Xiang
This has been built in hbase for quite some time, no application change. On Thu, Dec 6, 2012 at 11:08 AM, yun peng pengyunm...@gmail.com wrote: Is that done in current HBase implementation (say, 0.94.2 or more recent one) or it requires applications to handle it? Thanks for your note, Yun

Re: Does HBase combine multiple Puts against the same region server?

2012-12-06 Thread Varun Sharma
The code does the the following: 1) Add put to buffer 2) If buffer is size (2MB) - then flush the puts 3) Finally, for the left over puts in the buffer - if auto flush if on (which is the default), flush the puts When you flush your puts, the puts are grouped by regionserver and a single call