It looks like you are managing zk yourself? Default is that zk only allows 10 connections. Up it to 1000 for now. Its maxClientCnxns. St.Ack
On Wed, Jun 1, 2011 at 11:42 PM, Harold Lim <[email protected]> wrote: > I'm running HBase 0.90.2. > > > -Harold > > --- On Thu, 6/2/11, Ted Dunning <[email protected]> wrote: > >> From: Ted Dunning <[email protected]> >> Subject: Re: How to improve HBase throughput with YCSB? >> To: [email protected] >> Date: Thursday, June 2, 2011, 2:34 AM >> Zookeeper has an internal limit on >> number of connections. >> >> Which version of hbase are you running? >> >> On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim <[email protected]> >> wrote: >> >> > Hi Ted, >> > >> > For some reason, when I try the forked version of >> YCSB, I can't seem to >> > launch more than 10 threads. I start getting the >> following errors: >> > >> > >> > >> > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: Initiating >> client connection, >> > connectString=xxxxxx:2181 sessionTimeout=180000 >> watcher=hconnection >> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Opening >> socket connection to >> > server xxxxxx:2181 >> > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Socket >> connection established >> > to xxxxxx:2181, initiating session >> > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: Session >> 0x0 for server >> > xxxxxx:2181, unexpected error, closing socket >> connection and attempting >> > reconnect >> > java.io.IOException: Connection reset by peer >> > at >> sun.nio.ch.FileDispatcher.read0(Native Method) >> > at >> sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21) >> > at >> sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202) >> > at >> sun.nio.ch.IOUtil.read(IOUtil.java:169) >> > at >> sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243) >> > at >> > >> org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858) >> > at >> > >> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130) >> > >> > >> > Thanks, >> > Harold >> > --- On Tue, 5/31/11, Ted Dunning <[email protected]> >> wrote: >> > >> > > From: Ted Dunning <[email protected]> >> > > Subject: Re: How to improve HBase throughput with >> YCSB? >> > > To: [email protected] >> > > Date: Tuesday, May 31, 2011, 2:22 AM >> > > It may make it better. >> > > >> > > We should have an update shortly that will allow >> multiple >> > > machines to >> > > participate in generating load. A single >> YCSB is >> > > sufficient to stress a few >> > > nodes but once you get to 10 or more (especially >> with MapR >> > > underneath) you >> > > really need a cluster to generate the load. >> > > >> > > The synchronization strategy is very >> simple. We load >> > > up as usual and wait >> > > for a file to appear in Zookeeper. When it >> appears, >> > > the load turns on. >> > > >> > > On Mon, May 30, 2011 at 10:08 PM, Harold Lim >> <[email protected]> >> > > wrote: >> > > >> > > > I also see that you have a forked version of >> YCSB, >> > > will that make my >> > > > performance better? >> > > > >> > > >> > >> >
