Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-15 Thread praveenesh kumar
I am not able to see the total number of connections as 2k. Here is my zookeeper output : HBase is rooted at /hbase Master address: ub13:6 Region server holding ROOT: ub5:60020 Region servers: ub8:60020 ub12:60020 ub11:60020 ub4:60020 ub2:60020 ub13:60020 ub7:60020 ub3:60020

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-15 Thread Stack
hmmm... I just took a look and I don't see zk dumping it out anywhere. Could run a script that puts up 2k -1 clients and see how far you get? (Maybe someone else has better idea). St.Ack On Fri, Jul 15, 2011 at 3:22 AM, praveenesh kumar praveen...@gmail.com wrote: I am not able to see the

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread praveenesh kumar
Guys.. I have increased the zookeeper connections to 2000, still I am getting the same zookeeper exception while running the pig scripts. Can anyone tell me what can be the reason ? Thanks, Praveenesh On Fri, Jul 8, 2011 at 12:16 AM, Barney Frank barneyfran...@gmail.comwrote: Why not just set

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread praveenesh kumar
Hi, I have 3 machines configured as my zookeepr quorum. I am pasting the latest zookeeper logs of these 3 machines.. Can anyone have a look and tell me whether everything is going fine or not ? http://pastebin.com/EC2tgEN9- on Machine ub13 http://pastebin.com/JccPy5Ry-

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread praveenesh kumar
I restarted Hbase.. Is there any specific way to do that ? On Fri, Jul 8, 2011 at 8:35 PM, Stack st...@duboce.net wrote: Did you restart your zk ensemble after making the change? St.Ack On Fri, Jul 8, 2011 at 2:31 AM, praveenesh kumar praveen...@gmail.com wrote: Guys.. I have increased

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread Stack
Is hbase managing zk? Did you see zk restart when you restarted hbase? St.Ack On Fri, Jul 8, 2011 at 8:09 AM, praveenesh kumar praveen...@gmail.com wrote: I restarted Hbase.. Is there any specific way to do that ? On Fri, Jul 8, 2011 at 8:35 PM, Stack st...@duboce.net wrote: Did you restart

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread praveenesh kumar
yeah..!! On Fri, Jul 8, 2011 at 8:43 PM, Stack st...@duboce.net wrote: Is hbase managing zk? Did you see zk restart when you restarted hbase? St.Ack On Fri, Jul 8, 2011 at 8:09 AM, praveenesh kumar praveen...@gmail.com wrote: I restarted Hbase.. Is there any specific way to do that ?

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-08 Thread Stack
When you looked at zk with zkdump or via the zkcli did it show max connections as 2k? St.Ack On Fri, Jul 8, 2011 at 8:14 AM, praveenesh kumar praveen...@gmail.com wrote: yeah..!! On Fri, Jul 8, 2011 at 8:43 PM, Stack st...@duboce.net wrote: Is hbase managing zk?  Did you see zk restart when

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread praveenesh kumar
yeah.. exactly.,,my pig jobs are failing. I have send the issue in user@pig mailing list.. but still couldn't get good response from anyone. Here is the link of my post

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread Stack
On Thu, Jul 7, 2011 at 8:54 AM, praveenesh kumar praveen...@gmail.com wrote: Can you please go through this and tell me what can be the issue ? Can you summarize? (Life is short) If stuff works generally -- shell? And can you do the hbase rowcounter mapreduce job successfully -- but then

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread praveenesh kumar
My HBase and pig both are running fine for me.. Only problem is coming whenever I am trying to access big hbase table containing too many columns and rows.. whenever I am trying to access hbase table from pig... I am getting this following error in the middle of the map process:

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread Ted Yu
Increase hbase.zookeeper.property.maxClientCnxns to much bigger value. On Thu, Jul 7, 2011 at 10:46 AM, praveenesh kumar praveen...@gmail.comwrote: My HBase and pig both are running fine for me.. Only problem is coming whenever I am trying to access big hbase table containing too many

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread praveenesh kumar
I did that.. I increased it to 200.. still facing the same error.. what should be the ideal value ? On Thu, Jul 7, 2011 at 11:20 PM, Ted Yu yuzhih...@gmail.com wrote: Increase hbase.zookeeper.property.maxClientCnxns to much bigger value. On Thu, Jul 7, 2011 at 10:46 AM, praveenesh kumar

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread Ted Yu
To 1000. Click on 'zk dump' link from Master UI. You would know roughly how many connections were established. If 1000 is exhausted, increase more. See http://zhihongyu.blogspot.com/2011/04/managing-connections-in-hbase-090-and.html On Thu, Jul 7, 2011 at 10:52 AM, praveenesh kumar

Re: how to check whether zookeeper quorum is working fine or not ?

2011-07-07 Thread Barney Frank
Why not just set the maxClientCnxcns to 0? That would make it unlimited, right? On Thu, Jul 7, 2011 at 12:55 PM, Ted Yu yuzhih...@gmail.com wrote: To 1000. Click on 'zk dump' link from Master UI. You would know roughly how many connections were established. If 1000 is exhausted, increase

how to check whether zookeeper quorum is working fine or not ?

2011-07-05 Thread praveenesh kumar
Hi, I have a 12-node hbase cluster setup with 3 nodes as a part of zookeeper quorum. I am able to run hbase shell, create tables.. and able to access tables in the shell. Now I am configuring pig to use hbase. While accessing records using pig, it is giving some Zookeeper exception and saying to