Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-15 Thread Serega Sheypak
...@gmail.com To: user user@hbase.apache.org Sent: Friday, December 12, 2014 11:45 AM Subject: Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet requests per second. Servlet is NOT single

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-15 Thread lars hofhansl
      From: Serega Sheypak serega.shey...@gmail.com   To: user user@hbase.apache.org   Sent: Friday, December 12, 2014 11:45 AM   Subject: Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-15 Thread Serega Sheypak
@hbase.apache.org Cc: lars hofhansl la...@apache.org Sent: Monday, December 15, 2014 5:57 AM Subject: Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 Hi, the problem is gone. I did what you say :) Thanks! 2014-12-13 22:38 GMT

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-13 Thread Serega Sheypak
Hm... confusing, So here is the code path: 1. Servlet has doPost method 2. HistoryController instantiated during each doPost request. HistoryController is Logic wrapper around low-level HBase persistence stuff Each doPost invokes: final HistoryController getHistoryController(){ return new

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-13 Thread lars hofhansl
To: user user@hbase.apache.org Sent: Friday, December 12, 2014 11:45 AM Subject: Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet requests per second. Servlet is NOT single-threaded. each doPost/doGet

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-13 Thread Serega Sheypak
with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet requests per second. Servlet is NOT single-threaded. each doPost/doGet invokes these lines (encapsulated in DAO): 16 HConnection connection = HConnectionManager.createConnection

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-13 Thread Stack
From: Serega Sheypak serega.shey...@gmail.com To: user user@hbase.apache.org Sent: Friday, December 12, 2014 11:45 AM Subject: Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet requests per second

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-13 Thread Serega Sheypak
leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60 i have 10K doPost/doGet requests per second. Servlet is NOT single-threaded. each doPost/doGet invokes these lines (encapsulated in DAO): 16 HConnection connection

HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
Hi, I'm using HConnectionManager from java servlet Looks like it's leaking, all my zookeepers complains that there is too many connections from servlet hosts. Typical line from lZK log: oo many connections from /my.tomcat.server.com - max is 60 Here is code sample public class BaseConnection

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
Does zk count go up on each request to the servlet? Which version of hbase so can try on this end? Do you have some client-side log? Better if you cache the connection rather than make it each time since setup is costly but lets fix first problem first. St.Ack On Fri, Dec 12, 2014 at 2:47 AM,

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
Hi, I'm using CDH 5.2, 0.98 I don't know how to use it correctly. I've just used this sample: https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HConnectionManager.html HConnection connection = HConnectionManager.createConnection(config); HTableInterface table =

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
I cannot reproduce. I stood up a cdh5.2 server and then copy/pasted your code adding in a put for each cycle. I ran loop 1000 times and no complaint from zk. Tell me more (Is servlet doing single-threaded model? A single Configuration is being used or new ones are being created per servlet

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Serega Sheypak
i have 10K doPost/doGet requests per second. Servlet is NOT single-threaded. each doPost/doGet invokes these lines (encapsulated in DAO): 16 HConnection connection = HConnectionManager.createConnection(config); 17 HTableInterface table =

Re: HConnectionManager leaks with zookeeper conection oo many connections from /my.tomcat.server.com - max is 60

2014-12-12 Thread Stack
On Fri, Dec 12, 2014 at 11:45 AM, Serega Sheypak serega.shey...@gmail.com wrote: i have 10K doPost/doGet requests per second. How many concurrent threads going on in your tomcat? Is the Connection shared amongst all threads? Perhaps you have 60 concurrent connections running at a time and