RE: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Curt Allred
Actually, I first encountered the problem when I was using HBase standalone, i.e. outside of map-reduce. I use an HTable client to simultaneously scan and update a table. While iterating the scan, I do a put() of a single column back to the current row returned by the scanner. What I see is

Re: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Ryan Rawson
Yes that should work. What version of hbase are you using? I would appreciate a test case :-) -ryan On Thu, Sep 30, 2010 at 2:47 PM, Curt Allred c...@mediosystems.com wrote: Actually, I first encountered the problem when I was using HBase standalone, i.e. outside of map-reduce.  I use an

RE: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Curt Allred
version 0.20.3. I'll try to reduce my code to a testcase I can give you. Thanks! -Original Message- From: Ryan Rawson [mailto:ryano...@gmail.com] Sent: Thursday, September 30, 2010 2:53 PM To: user@hbase.apache.org Subject: Re: Is it legal to write to the same HBase table you're

Re: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Ryan Rawson
Can you also try 0.20.6 and see if you can repro on that? There has been a lot of changes between those versions that potentially affect this issue. -ryan On Thu, Sep 30, 2010 at 2:58 PM, Curt Allred c...@mediosystems.com wrote: version 0.20.3. I'll try to reduce my code to a testcase I can

RE: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Michael Segel
Sorry to jump in on the tail end of this... What sort of buffer size do you have on your client? What it sounds like is that you're doing a put() but you don't see the row in the table until either the client side buffer is full or if you've flushed the buffer which then writes the records to

RE: Is it legal to write to the same HBase table you're scanning?

2010-09-30 Thread Curt Allred
I didnt try changing the write buffer size from the default. Looks like the default is 2MB. I'll try setting it to zero. Thanks for the tip. -Original Message- From: Michael Segel [mailto:michael_se...@hotmail.com] Sent: Thursday, September 30, 2010 4:19 PM To: user@hbase.apache.org