Hi St.Ack, In my setup, Zk is being managed by HBase. I'll try increasing maxClientCnxns.
Thanks, Harold --- On Thu, 6/2/11, Stack <[email protected]> wrote: > From: Stack <[email protected]> > Subject: Re: How to improve HBase throughput with YCSB? > To: [email protected] > Date: Thursday, June 2, 2011, 11:34 AM > It looks like you are managing zk > yourself? Default is that zk only > allows 10 connections. Up it to 1000 for now. > Its maxClientCnxns. > St.Ack > > On Wed, Jun 1, 2011 at 11:42 PM, Harold Lim <[email protected]> > wrote: > > I'm running HBase 0.90.2. > > > > > > -Harold > > > > --- On Thu, 6/2/11, Ted Dunning <[email protected]> > wrote: > > > >> From: Ted Dunning <[email protected]> > >> Subject: Re: How to improve HBase throughput with > YCSB? > >> To: [email protected] > >> Date: Thursday, June 2, 2011, 2:34 AM > >> Zookeeper has an internal limit on > >> number of connections. > >> > >> Which version of hbase are you running? > >> > >> On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim <[email protected]> > >> wrote: > >> > >> > Hi Ted, > >> > > >> > For some reason, when I try the forked > version of > >> YCSB, I can't seem to > >> > launch more than 10 threads. I start getting > the > >> following errors: > >> > > >> > > >> > > >> > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: > Initiating > >> client connection, > >> > connectString=xxxxxx:2181 > sessionTimeout=180000 > >> watcher=hconnection > >> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: > Opening > >> socket connection to > >> > server xxxxxx:2181 > >> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: > Socket > >> connection established > >> > to xxxxxx:2181, initiating session > >> > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: > Session > >> 0x0 for server > >> > xxxxxx:2181, unexpected error, closing > socket > >> connection and attempting > >> > reconnect > >> > java.io.IOException: Connection reset by > peer > >> > at > >> sun.nio.ch.FileDispatcher.read0(Native Method) > >> > at > >> > sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21) > >> > at > >> > sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202) > >> > at > >> sun.nio.ch.IOUtil.read(IOUtil.java:169) > >> > at > >> > sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243) > >> > at > >> > > >> > org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858) > >> > at > >> > > >> > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130) > >> > > >> > > >> > Thanks, > >> > Harold > >> > --- On Tue, 5/31/11, Ted Dunning <[email protected]> > >> wrote: > >> > > >> > > From: Ted Dunning <[email protected]> > >> > > Subject: Re: How to improve HBase > throughput with > >> YCSB? > >> > > To: [email protected] > >> > > Date: Tuesday, May 31, 2011, 2:22 AM > >> > > It may make it better. > >> > > > >> > > We should have an update shortly that > will allow > >> multiple > >> > > machines to > >> > > participate in generating load. A > single > >> YCSB is > >> > > sufficient to stress a few > >> > > nodes but once you get to 10 or more > (especially > >> with MapR > >> > > underneath) you > >> > > really need a cluster to generate the > load. > >> > > > >> > > The synchronization strategy is very > >> simple. We load > >> > > up as usual and wait > >> > > for a file to appear in Zookeeper. > When it > >> appears, > >> > > the load turns on. > >> > > > >> > > On Mon, May 30, 2011 at 10:08 PM, Harold > Lim > >> <[email protected]> > >> > > wrote: > >> > > > >> > > > I also see that you have a forked > version of > >> YCSB, > >> > > will that make my > >> > > > performance better? > >> > > > > >> > > > >> > > >> > > >
