Zookeeper has an internal limit on number of connections. Which version of hbase are you running?
On Wed, Jun 1, 2011 at 11:20 PM, Harold Lim <[email protected]> wrote: > Hi Ted, > > For some reason, when I try the forked version of YCSB, I can't seem to > launch more than 10 threads. I start getting the following errors: > > > > 11/06/02 02:17:35 INFO zookeeper.ZooKeeper: Initiating client connection, > connectString=xxxxxx:2181 sessionTimeout=180000 watcher=hconnection > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Opening socket connection to > server xxxxxx:2181 > 11/06/02 02:17:35 INFO zookeeper.ClientCnxn: Socket connection established > to xxxxxx:2181, initiating session > 11/06/02 02:17:35 WARN zookeeper.ClientCnxn: Session 0x0 for server > xxxxxx:2181, unexpected error, closing socket connection and attempting > reconnect > java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcher.read0(Native Method) > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21) > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:202) > at sun.nio.ch.IOUtil.read(IOUtil.java:169) > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243) > at > org.apache.zookeeper.ClientCnxn$SendThread.doIO(ClientCnxn.java:858) > at > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1130) > > > Thanks, > Harold > --- On Tue, 5/31/11, Ted Dunning <[email protected]> wrote: > > > From: Ted Dunning <[email protected]> > > Subject: Re: How to improve HBase throughput with YCSB? > > To: [email protected] > > Date: Tuesday, May 31, 2011, 2:22 AM > > It may make it better. > > > > We should have an update shortly that will allow multiple > > machines to > > participate in generating load. A single YCSB is > > sufficient to stress a few > > nodes but once you get to 10 or more (especially with MapR > > underneath) you > > really need a cluster to generate the load. > > > > The synchronization strategy is very simple. We load > > up as usual and wait > > for a file to appear in Zookeeper. When it appears, > > the load turns on. > > > > On Mon, May 30, 2011 at 10:08 PM, Harold Lim <[email protected]> > > wrote: > > > > > I also see that you have a forked version of YCSB, > > will that make my > > > performance better? > > > > > >
