Re: Unique Id Generation

2009-04-24 Thread Satish Bhatti
bits) and child (32 bits)) would form a long. I don't think this should be very hard to implement. Their is nothing in zookeeper (out of the box) currently that would help you out. Mahadev On 4/23/09 4:52 PM, Satish Bhatti cthd2...@gmail.com wrote: We currently use a database sequence

Re: Unique Id Generation

2009-04-24 Thread Satish Bhatti
with that approach, but you should be able to generate millions of guaranteed unique id's per second and these id's should be pretty dense if each process generates lots of id's. On Thu, Apr 23, 2009 at 4:52 PM, Satish Bhatti cthd2...@gmail.com wrote: We currently use a database sequence

Re: Unique Id Generation

2009-04-24 Thread Satish Bhatti
. With (c), you could have potentially large gaps in the sequence, but 64 bits that shouldn't be a big deal. Code for that version would be the simplest of any of them. On Fri, Apr 24, 2009 at 8:56 AM, Satish Bhatti cthd2...@gmail.com wrote: Hello Ben, Basically the ids are document Ids. We

Moving ZooKeeper Servers

2009-05-04 Thread Satish Bhatti
Here is the scenario: (1) We have 2 live instances of our application, running on 2 different sets of machines, a preproduction instance and a production instance. As part of this setup we have 5 ZooKeeper servers running on machines pre-1 thru pre-5. They have been running for several days.

Re: Moving ZooKeeper Servers

2009-05-06 Thread Satish Bhatti
I ended up going with that suggestion, a short recursive function did the trick! However, I noticed the following nodes: /zookeeper /zookeeper/quota that were not created by me. So I ignored them. Is this correct? Satish On Mon, May 4, 2009 at 4:33 PM, Ted Dunning ted.dunn...@gmail.com

ZooKeeper viewer

2009-05-26 Thread Satish Bhatti
Does anybody have a utility to view a ZooKeeper cluster? Something like a file tree viewer? Satish

Re: ZooKeeper viewer

2009-05-27 Thread Satish Bhatti
that we can release it to the community. On Tue, May 26, 2009 at 4:22 PM, Satish Bhatti cthd2...@gmail.com wrote: Does anybody have a utility to view a ZooKeeper cluster? Something like a file tree viewer? Satish -- Ted Dunning, CTO DeepDyve -- Ted Dunning, CTO

ZooKeeper heavy CPU utilisation

2009-06-02 Thread Satish Bhatti
I am running a 5 node ZooKeeper cluster and I noticed that one of them has very high CPU usage: PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 6883 infact 22 0 725m 41m 4188 S 95 0.5 5671:54 java It is not doing anything application-wise at this

Re: ZooKeeper heavy CPU utilisation

2009-06-02 Thread Satish Bhatti
Satish Bhatti wrote: I am running a 5 node ZooKeeper cluster and I noticed that one of them has very high CPU usage: PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 6883 infact 22 0 725m 41m 4188 S 95 0.5 5671:54 java It is not doing

Re: ZooKeeper heavy CPU utilisation

2009-06-02 Thread Satish Bhatti
with this guess so that we all get smarter! On Tue, Jun 2, 2009 at 12:07 PM, Satish Bhatti cthd2...@gmail.com wrote: I am running a 5 node ZooKeeper cluster and I noticed that one of them has very high CPU usage: PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 6883

Re: ZooKeeper heavy CPU utilisation

2009-06-02 Thread Satish Bhatti
do the following - For all the threads for the zookeeper server you are seeing the problem on, Can you do an strace on all the threads and see which thread is spinning? Also, can you upload the configs of the servers to the jira that you create? mahadev On 6/2/09 1:29 PM, Satish Bhatti

Re: ZooKeeper heavy CPU utilisation

2009-06-02 Thread Satish Bhatti
is the second client doing? On Tue, Jun 2, 2009 at 1:49 PM, Satish Bhatti cthd2...@gmail.com wrote: stat Zookeeper version: 3.1.1-755636, built on 03/18/2009 16:52 GMT Clients: /127.0.0.1:42460[1](queued=0,recved=0,sent=0) /172.16.0.178:34283[1](queued=0,recved=925109,sent=925109

Re: zookeeper on ec2

2009-09-01 Thread Satish Bhatti
needs special care since: When a ZooKeeper client loses a connection to the ZooKeeper server there may be some requests in flight; we don't know where they were in their flight at the time of the connection loss. Patrick Satish Bhatti wrote: I have recently started running on EC2 and am

Re: zookeeper on ec2

2009-09-01 Thread Satish Bhatti
gc pressure), etc...) Patrick Satish Bhatti wrote: Session timeout is 30 seconds. On Tue, Sep 1, 2009 at 4:26 PM, Patrick Hunt ph...@apache.org wrote: What is your client timeout? It may be too low. also see this section on handling recoverable errors: http://wiki.apache.org/hadoop

Re: zookeeper on ec2

2009-09-01 Thread Satish Bhatti
:46 PM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi satish, what GC are you using? Is it ConcurrentMarkSweep or Parallel/Serial? Also, how is your disk usage on this machine? Can you check your iostat numbers? Thanks mahadev On 9/1/09 5:15 PM, Satish Bhatti cthd2...@gmail.com wrote