Hi Ted, I increased the max client connections for zookeeper to some really big number. However, when I start YCSB with > 30 threads, It continuously prints out: 11/06/03 01:53:47 INFO zookeeper.ClientCnxn: Session establishment complete on server xxxxx:2181, sessionid = 0x13053f70e3536b1, negotiated timeout = 180000 11/06/03 01:53:47 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=xxxx:2181 sessionTimeout=180000 watcher=hconnection 11/06/03 01:53:47 INFO zookeeper.ClientCnxn: Opening socket connection to server xxxxx:2181
-Harold --- On Thu, 6/2/11, Ted Dunning <[email protected]> wrote: > From: Ted Dunning <[email protected]> > Subject: Re: How to improve HBase throughput with YCSB? > To: [email protected] > Date: Thursday, June 2, 2011, 2:48 AM > Yeah.. there is a bug on that. > > I am spacing the number right now. And I have to > run. > > On Wed, Jun 1, 2011 at 11:42 PM, Harold Lim <[email protected]> > wrote: > > > I'm running HBase 0.90.2. > > > > > > -Harold > > > > --- On Thu, 6/2/11, Ted Dunning <[email protected]> > wrote: > > > > > From: Ted Dunning <[email protected]> > > > Subject: Re: How to improve HBase throughput with > YCSB? > > > To: [email protected] > > > Date: Thursday, June 2, 2011, 2:34 AM > > > Zookeeper has an internal limit on > > > number of connections. > > > > > > Which version of hbase are you running? > > > > > > On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim > <[email protected]> > > > wrote: > > > > > > > Hi Ted, > > > > > > > > For some reason, when I try the forked > version of > > > YCSB, I can't seem to > > > > launch more than 10 threads. I start getting > the > > > following errors: > > > > > > > > > > > > > > > > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: > Initiating > > > client connection, > > > > connectString=xxxxxx:2181 > sessionTimeout=180000 > > > watcher=hconnection > > > > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: > Opening > > > socket connection to > > > > server xxxxxx:2181 > > > > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: > Socket > > > connection established > > > > to xxxxxx:2181, initiating session > > > > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: > Session > > > 0x0 for server > > > > xxxxxx:2181, unexpected error, closing > socket > > > connection and attempting > > > > reconnect > > > > java.io.IOException: Connection reset by > peer > > > > at > > > sun.nio.ch.FileDispatcher.read0(Native Method) > > > > at > > > > sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21) > > > > at > > > > sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202) > > > > at > > > sun.nio.ch.IOUtil.read(IOUtil.java:169) > > > > at > > > > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243) > > > > at > > > > > > > > org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858) > > > > at > > > > > > > > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130) > > > > > > > > > > > > Thanks, > > > > Harold > > > > --- On Tue, 5/31/11, Ted Dunning <[email protected]> > > > wrote: > > > > > > > > > From: Ted Dunning <[email protected]> > > > > > Subject: Re: How to improve HBase > throughput with > > > YCSB? > > > > > To: [email protected] > > > > > Date: Tuesday, May 31, 2011, 2:22 AM > > > > > It may make it better. > > > > > > > > > > We should have an update shortly that > will allow > > > multiple > > > > > machines to > > > > > participate in generating load. A > single > > > YCSB is > > > > > sufficient to stress a few > > > > > nodes but once you get to 10 or more > (especially > > > with MapR > > > > > underneath) you > > > > > really need a cluster to generate the > load. > > > > > > > > > > The synchronization strategy is very > > > simple. We load > > > > > up as usual and wait > > > > > for a file to appear in > Zookeeper. When it > > > appears, > > > > > the load turns on. > > > > > > > > > > On Mon, May 30, 2011 at 10:08 PM, > Harold Lim > > > <[email protected]> > > > > > wrote: > > > > > > > > > > > I also see that you have a forked > version of > > > YCSB, > > > > > will that make my > > > > > > performance better? > > > > > > > > > > > > > > > > > > > > >
