Andy, I did originally try to use the 0.89 release, but could not get a fully distributed mode setup that would run on either Hadoop 0.20 or Hadoop 0.21. I could certainly give it another try.
At the moment I am using a CDH3 based deployment that in all other respects is working quite well. I am not planning on using Stargate in production, it is just a readily available hbase proxy that exhibits the symptom I see in our custom proxy server. They both use HTablePool. I will see if I can get 0.89 to run on CHD3 again and see if the same syptom appears. thanks, -jeremy On Tue, Oct 19, 2010 at 06:28:40PM -0700, Andrew Purtell wrote: > Jeremy, > > Have you given any thought to trying out the latest 0.89 release? > > The Stargate package has been moved into org.apache.hadoop.hbase.rest but > otherwise it is the same. > > If this is a concurrency problem with the HBase client library it would be > better to try and deal with it on what is currently under development, if you > do not have a specific requirement to use 0.20.x. > > Best regards, > > - Andy > > > --- On Tue, 10/19/10, Jeremy Hinegardner <[email protected]> wrote: > > > From: Jeremy Hinegardner <[email protected]> > > Subject: concurrency issue with Stargate/HTablePool > > To: [email protected] > > Date: Tuesday, October 19, 2010, 5:03 PM > > Hi all, > > > > I've done a bit of search on this issue, and have yet to > > find anything conclusive.? As a test case to demonstrate it, > > I am using HBase 0.20.6 and stargate. > > > > I have a test HBase cluster with 1 table and about 60M rows > > in it, and a Stargate instance that talks to it. > > > > I have clients that queue up a random list of rowid's to > > query stargate via http://stargate.example.com:3002/table/rowid > > like requests. > > > > When I have 3 concurrent clients querying stargate, they > > all do well and get > > a consistent throughput.? When I add the 4th client > > querying stargate, stargate > > comes to a screeching halt and everyone has 0 operations > > for a long while, then > > a small burst of requests will go through stargate and it > > will hang for a while, > > and repeat. > > > > If I then just kill one client, the other 3 start having a > > good consistent > > throughput again.? Bring back the 4th client and it > > comes to a halt. > > > > If I bypass Stargate completely, and have all clients use > > HTable instances > > directly, then everyone is good.? I can go up to as > > many clients as I need. > > > > This seems like quite a problem and I was wondering if > > anyone else is > > seeing something similar.? > > > > thank you for your time, > > > > -jeremy > > > > > > -- > > ======================================================================== > > Jeremy Hinegardner? ? ? ? ? > > ? ? ? ? ? ? ? ? > > ? ? [email protected] > > > > > > > > > -- ======================================================================== Jeremy Hinegardner [email protected]
