Re: txzookeeper - a twisted python client for zookeeper

Nice. Any chance of putting it back in zk? Would be useful. Thanks mahadev On 11/18/10 1:17 PM, Kapil Thangavelu kapil.f...@gmail.com wrote: At canonical we've been using zookeeper heavily in the development of a new project (ensemble) as noted by gustavo. I just wanted to give a quick

Re: JUnit tests do not produce logs if the JVM crashes

Hi Andras, Junit unit will always buffer the logs unless you print it out to console. To do that, try running this ant test -Dtest.output=yes This will print out the logs to console as they are logged. Thanks mahadev On 11/4/10 3:33 AM, András Kövi allp...@gmail.com wrote: Hi all, I'm

FW: [Hadoop Wiki] Update of ZooKeeper/ZKClientBindings by yfinkelstein

Nice to see this! Thanks mahadev -- Forwarded Message From: Apache Wiki wikidi...@apache.org Reply-To: common-...@hadoop.apache.org Date: Tue, 2 Nov 2010 14:39:24 -0700 To: Apache Wiki wikidi...@apache.org Subject: [Hadoop Wiki] Update of ZooKeeper/ZKClientBindings by yfinkelstein Dear Wiki

Re: Problem with Zookeeper cluster configuration

I think Jared pointed this out, given that your clientPort and quorum port are same: clientPort=5181 server.1=3.7.192.142:5181:5888 The above 2 ports should be different. Thanks mahadev On 10/27/10 10:19 AM, Ted Dunning ted.dunn...@gmail.com wrote:

Re: Unusual exception

Hi Avinash, Not sure if you got a response for your email. The exception that you mention mostly means that the client already closed the socket or shutdown. Looks like a client is trying to connect but disconnects before the server can respond. Do you have any such clients? Is this causing

Re: Zookeeper on 60+Gb mem

Hi Maarteen, I definitely know of a group which uses around 3GB of memory heap for zookeeper but never heard of someone with such huge requirements. I would say it definitely would be a learning experience with such high memory which I definitely think would be very very useful for others in the

Re: possible bug in zookeeper ?

Hi Yatir, Any update on this? Are you still struggling with this problem? Thanks mahadev On 9/15/10 12:56 AM, Yatir Ben Shlomo yat...@outbrain.com wrote: Thanks to all who replied, I appreciate your efforts: 1. There is no connections problem from the client machine:

Re: Expiring session... timeout of 600000ms exceeded

Am not sure, if anyone responded to this or not. Are the clients getting session expired or getting Connectionloss? In any case, zookeeper client has its own thread to updated the server with active connection status. Did you take a look at the GC activity at your client? Thanks mahadev On

Re: SessionMovedException

Hi Jun, You can read more about the SessionMovedException at http://hadoop.apache.org/zookeeper/docs/r3.3.0/zookeeperProgrammers.html Thanks mahadev On 10/1/10 9:58 AM, Jun Rao jun...@gmail.com wrote: Hi, Could someone explain what SessionMovedException means? Should it be treated as

Re: zkfuse

Hi Jun, I havent seen people using zkfuse recently. What kind of issues are you facing? Thanks mahadev On 9/19/10 6:46 PM, 俊贤 junx...@taobao.com wrote: Hi guys, Has anyone succeeded in installing the zkfuse? This email (including any attachments) is

Re: possible bug in zookeeper ?

Hi yatir, Can you confirm that zook1 , zook2 can be nslookedup from the client machine? We havent seen a bug like this. It would be great to nail this down. Thanks mahadev On 9/14/10 8:44 AM, Yatir Ben Shlomo yat...@outbrain.com wrote: zook1:2181,zook2:2181,zook3:2181 -Original

Re: Receiving create events for self with synchronous create

to encapsulate the detection of additions and deletions of child nodes within this Watcher. All other events that occur due to a node being added or deleted should be handled externally by the clustermanager. Thanks, Todd On Thu, 2010-08-26 at 19:26 -0700, Mahadev Konar wrote: Hi Todd, The code

Re: Lock example

Hi Tim, The lock recipe you mention is supposed to avoid her affect and prevent starvation (though it has bugs :)). Are you looking for something like that or just a simple lock and unlock that doesn't have to worry abt the above issues. If that's the case then just doing an ephemeral create

Re: Understanding ZooKeeper data file management and LogFormatter

Hi Vishal, Usually the default retention policy is safe enough for operations. http://hadoop.apache.org/zookeeper/docs/r3.1.1/zookeeperAdmin.html Gives you an overview of how to use the purging library in zookeeper. Thanks mahadev On 9/8/10 12:01 PM, Vishal K vishalm...@gmail.com wrote: Hi

Re: ZooKeeper C bindings and cygwin?

Hi Jan, It would be great to have some documentation on how to use the windows install. Would you mind submitting a patch with documentation with FAQ's and any other issues you might have faced? Thanks mahadev On 9/1/10 6:04 AM, jdeinh...@ujam.com jdeinh...@ujam.com wrote: Dear list

Re: getting created child on NodeChildrenChanged event

Hi Todd, We have always tried to lean on the side of keeping things lightweight and the api simple. The only way you would be able to do this is with sequential creates. 1. create nodes like /queueelement-$i where i is a monotonically increasing number. You could use the sequential flag of

Re: Logs and in memory operations

Hi Avinash, IN the source code the FinalRequestProcessor updates the in memory data structures and the SyncRequestProcessor logs to disk. For deciding when to delete take a look at PurgeTxnLog.java file. Thanks mahadev On 8/30/10 1:11 PM, Avinash Lakshman avinash.laksh...@gmail.com wrote:

Re: Spew after call to close

Hi Stack, Looks like you are shutting down the server and shutting down the client at the same time? Is that the issue? Thanks mahadev On 9/3/10 4:47 PM, Stack st...@duboce.net wrote: Have you fellas seen this before? I call close on zookeeper but it insists on doing the below exceptions.

Re: Receiving create events for self with synchronous create

Hi Todd, The code that you point to, I am not able to make out the sequence of steps. Can you be more clear on what you are trying to do in terms of zookeeper api? Thanks mahadev On 8/26/10 5:58 PM, Todd Nine t...@spidertracks.co.nz wrote: Hi all, I'm running into a strange issue I could

Re: Size of a znode in memory

Hi Marten, The usual memory footprint of a znode is around 40-80 bytes. I think Ben is planning to document a way to calculate approximate memory footprint of your zk servers given a set of updates and there sizes. thanks mahadev On 8/25/10 11:49 AM, Maarten Koopmans maar...@vrijheid.net

Re: Searching more ZooKeeper content

I am definitely a +1 on this, given that its powered by Solr. Thanks mahadev On 8/25/10 9:22 AM, Alex Baranau alex.barano...@gmail.com wrote: Hello guys, Over at http://search-hadoop.com we index ZooKeeper project's mailing lists, wiki, web site, source code, javadoc, jira... Would

Re: Parent nodes multi-step transactions

Hi Gustavo, Usually the paradigm I like to suggest is to have something like /A/init Every client watches for the existence of this node and this node is only created after /A has been initialized with the creation of /A/C or other stuff. Would that work for you? Thanks mahadev On 8/23/10

Re: Non Hadoop scheduling frameworks

Hi Todd, Just to be clear, are you looking at solving UC1 and UC2 via zookeeper? Or is this a broader question for scheduling on cassandra nodes? For the latter this probably isnt the right mailing list. Thanks mahadev On 8/23/10 4:02 PM, Todd Nine t...@spidertracks.co.nz wrote: Hi all,

Re: Zookeeper stops

Hi Wim, It mostly looks like that zookeeper is not able to create files on the /tmp filesystem. Is there is a space shortage or is it possible the file is being deleted as its being written to? Sometimes admins have a crontab on /tmp that cleans up the /tmp filesystem. Thanks mahadev On

Re: A question about Watcher

Hi Qian, The watcher information is saved at the client, and the client will reattach the watches to the new server it connects to. Hope that helps. Thanks mahadev On 8/16/10 9:28 AM, Qian Ye yeqian@gmail.com wrote: thx for explaination. Since the watcher can be preserved when the

Re: How to handle Node does not exist error?

HI Dr Hao, Can you please post the configuration of all the 3 zookeeper servers? I suspect it might be misconfigured clusters and they might not belong to the same ensemble. Just to be clear: /xpe/queues/3bd7851e79381ef4bfd1a5857b5e34c04e5159e5/msgs/msg002807 And other such nodes exist on

Re: Sequence Number Generation With Zookeeper

Hi David, I think it would be really useful. It would be very helpful for someone looking for geenrating unique tokens/generations ids ( I can think of plenty of applications for this). Please do consider contributing it back to the community! Thanks mahadev On 8/6/10 7:10 AM, David

Re: zkperl - skipped tests

Hi Martin, You might have to look into the tests. t/50_access.t is the file you might want to take a look at. I am not a perl guru so am not of much help but let me know if you cant work out the details on the skipped tests. I will try to dig into the perl code. Thanks mahadev On 8/4/10

Re: node symlinks

HI Maarteen, Can you elaborate on your use case of ZooKeeper? We currently don't have any symlinks feature in zookeeper. The only way to do it for you would be a client side hash/lookup table that buckets data to different zookeeper servers. Or you could also store this hash/lookup table in

Re: ZK recovery questions

Hi Ashwin, We have seen people wanting to have something like ZooKeeper without the reliability of permanent storage and are willing to work with loosened guarantees of current Zookeeper. What you mention on log files is certainly a valid use case. It would be great to see how much throughput

Re: unit test failure

HI Martin, Can you check if you have a stale java process (ZooKeeperServer) running on your machine? That might cause some issues with the tests. Thanks mahadev On 7/14/10 8:03 AM, Martin Waite waite@gmail.com wrote: Hi, I am attempting to build the C client on debian lenny.

Re: building client tools

Hi Martin, There is a list of tools, i.e cppunit. That is the only required tool to build the zookeeper c library. The readme says that it can be done without cppunit being installed but there has been a open bug regarding this. So cppunit is required as of now. Thanks mahadev On 7/13/10

Re: running the systest

Hi Stuart, The instructions are just out of date. If you could open a jira and post a patch to it that would be great! We should try getting this in 3.3.2! That would be useful! Thanks mahadev On 7/9/10 6:36 AM, Stuart Halloway stuart.hallo...@gmail.com wrote: Hi all, I am trying to run

Re: Suggested way to simulate client session expiration in unit tests?

Hi Jeremy, zk.disconnect() is the right way to disconnect from the servers. For session expiration you just have to make sure that the client stays disconnected for more than the session expiration interval. Hope that helps. Thanks mahadev On 7/6/10 9:09 AM, Jeremy Davis

Re: Securing ZooKeeper connections

Hi Vishal, Ben (Benjamin Reed) has been working on a netty based client server protocol in ZooKeeper. I think there is an open jira for it. My network connection is pretty slow so am finding it hard to search for it. We have been thinking abt enabling secure connections via this netty based

Re: Zookeeper EventThread and SendThread

Hi Nick, These threads are spawned with each zookeeper client handle. As soon as you create a zookeeper client object these threads are spawned. Are yu creating too many zookeeper client objects in your application? Htanks mahadev On 5/20/10 11:30 AM, Nick Bailey nicholas.bai...@rackspace.com

Re: Using ZooKeeper for managing solrCloud

Hi Rakhi, You can read more abt monitoring zookeeper servers at http://hadoop.apache.org/zookeeper/docs/r3.3.0/zookeeperAdmin.html#sc_monito ring Thanks mahadev On 5/14/10 4:09 AM, Rakhi Khatwani rkhatw...@gmail.com wrote: Hi, I just went through the zookeeper tutorial and

Re: Can't ls with large node count and I don't understand the use of jute.maxbuffer

Hi Aaaron, Each of the requests and response between client and servers is sent an (buflen, buffer) packet. The content of the packets are then deserialized from this buffer. Looks like the size of the packet (buflen) is big in yoru case. We usually avoid sending/receiving large packets just

Re: Xid out of order. Got 8 expected 7

Hi Jordan, Can you create a jira for this? And attach all the server logs and client logs related to this timeline? How did you start up the servers? Is there some changes you might have made accidentatlly to the servers? Thanks mahadev On 5/12/10 10:49 AM, Jordan Zimmerman

Re: ZookeeperPresentations Wiki

I just emailed in...@apache to ask for there help on this. I wasn't able to figure out what the problem is! Thanks for pointing it out. mahadev On 5/11/10 4:01 PM, Sudipto Das sudi...@cs.ucsb.edu wrote: Hi, I am trying to download some presentation slides from the ZookeeperPresentations

Re: New ZooKeeper client library Cages

Hi Dominic, Good to see this. I like the name cages :). You might want to post to the list what cages is useful for. I think quite a few folks would be interested in something like this. Are you guys currently using it with cassandra? Thanks mahadev On 5/11/10 4:02 PM, Dominic Williams

Re: avoiding deadlocks on client handle close w/ python/c api

Sure, Ill take a look at it. Thanks mahadev On 5/4/10 2:32 PM, Patrick Hunt ph...@apache.org wrote: Thanks Kapil, Mahadev perhaps you could take a look at this as well? Patrick On 05/04/2010 06:36 AM, Kapil Thangavelu wrote: I've constructed a simple example just using the zkpython

Re: ZKClient

Hi Adam, I don't think zk is very very hard to get right. There are exmaples in src/recipes which implements locks/queues/others. There is ZOOKEEPER-22 to make it even more easier for application to use. Regarding re registration of watches, you can deifnitely write code and submit is as a part

Re: Dynamic adding/removing ZK servers on client

Hi Dave, Just a question on how do you see it being used, meaning who would call addserver and removeserver? It does seem useful to be able to do this. This is definitely worth working on. You can link it as a subtask of ZOOKEEPER-107. Thanks mahadev On 5/3/10 7:03 AM, Dave Wright

Re: Dynamic adding/removing ZK servers on client

Yeah, that was one of the ideas, I think its been on the jira somewhere ( I forget)... But could be and would definitely be one soln for it. Thanks mahadev On 5/3/10 2:12 PM, Ted Dunning ted.dunn...@gmail.com wrote: Should this be a znode in the privileged namespace? On Mon, May 3, 2010 at

Re: Question on maintaining leader/membership status in zookeeper

Hi Lei, In this case, the Leader will be disconnected from ZK cluster and will give up its leadership. Since its disconnected, ZK cluster will realize that the Leader is dead! When Zk cluster realizes that the Leader is dead (this is because the zk cluster hasn't heard from the Leader for a

Re: Question on maintaining leader/membership status in zookeeper

, neither the leader nor the slaves will be considered disconnected because they can all connect to ZK. Thanks, Lei On 4/30/10 3:47 PM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Lei, In this case, the Leader will be disconnected from ZK cluster and will give up its leadership

Re: Question on maintaining leader/membership status in zookeeper

connect to ZK. Thanks, Lei On 4/30/10 3:47 PM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Lei, In this case, the Leader will be disconnected from ZK cluster and will give up its leadership. Since its disconnected, ZK cluster will realize that the Leader is dead! When Zk

Re: Embedding ZK in another application

We do set that Chad but it doesn't seem to help on some systems (especially bsd)... Thanks mahadev On 4/29/10 11:22 AM, Chad Harrington chad.harring...@gmail.com wrote: On Thu, Apr 29, 2010 at 8:49 AM, Patrick Hunt ph...@apache.org wrote: This is not foolproof however. We found that in

Re: Zookeeper client

HI Avinash, The zk client does itself maintain liveness information and also randomizes the list of servers to balance the number of clients connected to a single ZooKeeper server. Hope that helps. Thanks mahadev On 4/27/10 10:56 AM, Avinash Lakshman avinash.laksh...@gmail.com wrote: Let's

Re: Embedding ZK in another application

Hi Vishal and Ashanka, I think Ted and Pat had somewhat comentted on this before. Reiterating these comments below. If you are ok with these points I see no concern in ZooKeeper as an embedded application. Also, as Pat mentioned earlier there are some cases where the server code will

Re: Embedding ZK in another application

That's true! Thanks mahadev On 4/23/10 11:41 AM, Asankha C. Perera asan...@apache.org wrote: Hi Mahadev I think Ted and Pat had somewhat comentted on this before. Reiterating these comments below. If you are ok with these points I see no concern in ZooKeeper as an embedded

Re: bug: wrong heading in recipes doc

I think we should be using zookeeper locks to create jiras :) . Looks like both of you created one!!! :) Thanks mahadev On 4/22/10 1:37 PM, Patrick Hunt ph...@apache.org wrote: No problem. https://issues.apache.org/jira/browse/ZOOKEEPER-752 I've seen alot of traffic on

Re: odd error message

Ok, I think this is possible. So here is what happens currently. This has been a long standing bug and should be fixed in 3.4 https://issues.apache.org/jira/browse/ZOOKEEPER-335 A newly elected leader currently doesn't log the new leader transaction to its database In your case, the

Re: Recovery issue - how to debug?

Hi Hao, As Vishal already asked, how are you determining if the writes are being received? Also, what was the status of C2 when you checked for these writes? Do you have the output of echo stat | nc localhost port? How long did you wait when you say that C2 did not received the writes? What

Re: rolling upgrade 3.2.1 - 3.3.0

Hi Charity, Looks like you are hitting a bug recently found in 3.3.0. https://issues.apache.org/jira/browse/ZOOKEEPER-737 Is the bug, wherein the server does not show the right status. Looks like in your case the server is running fine but bin/zkserver.sh status is not returning the right

Re: feed queue fetcher with hadoop/zookeeper/gearman?

Hi Thomas, There are a couple of projects inside Yahoo! that use ZooKeeper as an event manager for feed processing. I am little bit unclear on your example below. As I understand it- 1. There are 1 million feeds that will be stored in Hbase. 2. A map reduce job will be run on these feeds to

Re: Errors while running sytest

Great. I was just responding with a different soln: '--- Looks like the fatjar does not include junit class. Also, the -jar option does not use the classpath environment variable. Here is an excerpt from the man page of java: -jar Execute a program encapsulated in

Re: deleting a node - command line tool

Hi Karthik, You can use bin/zkCli.sh which provides a nice command line shell interface for executing commands. Thanks mahadev On 3/26/10 9:42 AM, Karthik K oss@gmail.com wrote: Hi - I am looking to delete a node (say, /katta) from a running zk ensemble altogether and curious if

Re: Zookeeper unit tester?

Hi David, We don't really have a mock test ZooKeeper client which does not do any I/O. We have been thinking about using mockito sometime soon to use for this kind of testing, but currently there is none. Thanks mahadev On 3/9/10 2:23 PM, David Rosenstrauch dar...@darose.net wrote: Just

Re: Managing multi-site clusters with Zookeeper

to better than zk does and still maintain correctness. Do note that you can, probalbly bias client to use a local server. That should make things more efficient. Sent from my iPhone On Mar 7, 2010, at 3:00 PM, Mahadev Konar maha...@yahoo-inc.com wrote: The inter-site links

Re: Managing multi-site clusters with Zookeeper

Hi Martin, As Ted rightly mentions that ZooKeeper usually is run within a colo because of the low latency requirements of applications that it supports. Its definitely reasnoble to use it in a multi data center environments but you should realize the implications of it. The high latency/low

Re: Managing multi-site clusters with Zookeeper

21:43, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Martin, As Ted rightly mentions that ZooKeeper usually is run within a colo because of the low latency requirements of applications that it supports. Its definitely reasnoble to use it in a multi data center environments but you should

Re: zookeeper utils

Hi David, There is an implementation for locks and queues in src/recipes. The documentation residres in src/recipes/{lock/queue}/README.txt. Thanks mahadev On 3/2/10 1:04 PM, David Rosenstrauch dar...@darose.net wrote: Was reading through the zookeeper docs on the web - specifically the

Re: is there a good pattern for leases ?

waite@googlemail.com wrote: Hi Mahadev, That is interesting. All I need to do is hold the connection for the required time of a session that created an ephemeral node. Zookeeper is an interesting tool. Thanks again, Martin On 24 February 2010 17:00, Mahadev Konar maha...@yahoo

Re: how to lock one-of-many ?

Hi martin, Currently you cannot access the server that the client is connected to. This was fixed in this jira http://issues.apache.org/jira/browse/ZOOKEEPER-544 But again this does not tell you if you are connected to the primary or the other followers. So you will anyway have to do some

Re: how to lock one-of-many ?

Hi Martin, How about this- you have resources in the a directory (say /locks) each process which needs to lock, lists all the children of this directory and then creates an ephemeral node called /locks/resource1/lock depending on which resource it wants to lock. This ephemeral node will

Re: Bit of help debugging a TIMED OUT session please

at 11:26 AM, Mahadev Konar maha...@yahoo-inc.com wrote: I also looked at the logs. Ted might have a point. It does look like that zookeeper server's are doing fine (though as ted mentions the skew is a little concerning, though that might be due to very few packets served by the first server). Other

Re: Ordering guarantees for async callbacks vs watchers

Hi martin, a call like getchildren(final String path, Watcher watcher, ChildrenCallback cb, Object ctx) Means that set a watch on this node for any further changes on the server. A client will see the response to getchildren data before the above watch is fired. Hope that helps. Thanks

ZOOKEEPER-22 and release 3.3

Hi all, I had been working on zookeeper-22 and found out that it needs quite a few extensive changes. We will need to do some memory measurements to see if it has any memory impacts or not. Since we are targetting 3.3 release for early march, ZOOKEEPER-22 would be hard to get into 3.3. I am

Re: Q about ZK internal: how commit is being remembered

Qian, ZooKeeper gurantees that if a client sees some transaction response, then it will persist but the one's that a client does not see might be discarded or committed. So in case a quorum does not log the transaction, there might be a case wherein a zookeeper server which does not have the

Re: Server exception when closing session

Hi Josh, This warning is not of any concern. Just a quick question, is there any reason for you to runn the server on a DEBUG level? Thanks mahadev On 1/22/10 5:19 PM, Josh Scheid jsch...@velocetechnologies.com wrote: Is it normal for client session close() to cause a server exception?

Re: Server exception when closing session

at: http://wiki.apache.org/hadoop/ZooKeeper/ServiceLatencyOverview You can take a look at that as well and see what the expected performance should be for your workload. Thanks mahadev On 1/22/10 5:40 PM, Josh Scheid jsch...@velocetechnologies.com wrote: On Fri, Jan 22, 2010 at 17:22, Mahadev

Re: Question regarding Membership Election

Hi Vijay, Unfortunately you wont be able to keep running the observer in the other DC if the quorum in the DC 1 is dead. Most of the folks we have talked to also want to avoid voiting across colos. They usually run two instances of Zookeeper in 2 DC's and copy state of zookeeper (using a bridge)

Re: Namespace partitioning ?

Hi kay, the namespace partitioning in zookeeper has been on a back burner for a long time. There isnt any jira open on it. There had been some discussions on this but no real work. Flavio/Ben have had this on there minds for a while but no real work/proposal is out yet. May I know is this

Re: Killing a zookeeper server

Hi Adam, That seems fair to file as an improvement. Running 'stat' did return the right stats right? Saying the servers werent able to elect a leader? mahadev On 1/13/10 11:52 AM, Adam Rosien a...@rosien.net wrote: On a related note, it was initially confusing to me that the server

Re: Fetching sequential children

Hi ohad, there isnt a way to get a selected set of children from the servers. So you will have to get all of them and filter out the unwanted ones. Also, what Steve suggested in the other email might be useful for you. Thanks mahadev On 12/23/09 12:29 AM, Ohad Ben Porat o...@outbrain.com

Re: zkfuse

Hi Maarten, zkfuse does not have any support for acls. We havent had much time to focus on zkfuse. Create/read/write/delete/ls are all supported. It was built mostly for infrequent updates and more of a browsing interface on filesystem. I don't think zkfuse is being used in production anywhere.

Bugfix release 3.2.2

Hi all, We are planning to make a bugfix release 3.2.2 which will include a critical bugfix in the c client code. The jira is ZOOKEEPER-562, http://issues.apache.org/jira/browse/ZOOKEEPER-562. If you would like some fix to be considered for this bugfix release please feel free to post on the

Re: zookeeper viewer

Hi Hamoun, Can you please mention which link is broken? Are you a looking for a zookeeper tree browser? Pat created a dashboard for zookeeper at github. Below is the link: http://github.com/phunt/zookeeper_dashboard Also, there is an open jira for a zookeeper browser which you can try

Re: Restarting a single zookeeper Server on the same port within the process

Hi Siddharth, Usually the time of releasing the port is dependent on the OS. So you can try sleeping a few more seconds to see if the port has been released or it .. Or just poll on the port to see if its in use or not There isnt an easier way to restart on the same port. mahadev On

Re: Cluster Configuration Issues

HI Mark, ZooKeeper does not create the myid file in the data directory. Looking at the config file it looks like it is missing the quorum configuration for other servers. Please take alook at http://hadoop.apache.org/zookeeper/docs/r3.2.1/zookeeperAdmin.html#sc_zkMuli tServerSetup You will

Re: specifying the location of zookeeper.log

Hi Leonard, You should be able to set the ZOO_LOG_DIR as an environment variable to get a different log directory. I think you are using bin/zkServer.sh to start the server? Also, please open a jira for this. It would be good to fix the documentation for this. Thanks mahadev On 10/16/09

Re: specifying the location of zookeeper.log

} \ -cp $CLASSPATH $JVMFLAGS $ZOOMAIN $ZOOCFG I double checked by echo'ing the value of ZOO_LOG_DIR just before the java command. It's set correctly ... but it has no effect on the location of zookeeper.log :-( Leonard On 10/16/09 11:08 AM, Mahadev Konar maha...@yahoo-inc.com wrote

Re: specifying the location of zookeeper.log

log4j.appender.FILE.layout=org.apache.log4j.PatternLayout log4j.appender.FILE.layout.ConversionPattern=%d{ISO8601} - %-5p [%t:%c...@%l] - %m%n Will let you log to the output directory $dir. Hope that helps! mahadev On 10/16/09 11:35 AM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Leonard, Looks

Re: specifying the location of zookeeper.log

and forgotten that I'd done so. Thanks for your attention. Leonard On 10/16/09 11:35 AM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Leonard, Looks like you are right. bin/zkServer.sh just logs the output to console, so you should be able to redirect to any file you want. No? Anyways

Re: Start problem of Running Replicated ZooKeeper

Hi Le, Is there some chance of the these servers not being able to talk to each other? IS the zookeeper prcoess running on debian-1? What error do you see on debian-1? The connection refused error suggests that debian-0 is not able to talk to debian-1 machine. Thanks mahadev On 9/23/09

Re: ACL question w/ Zookeeper 3.1.1

HI todd, From what I understand, you are sayin that a creator_all_acl does not work with auth? I tried the following with CREATOR_ALL_ACL and it seemed to work for me... import org.apache.zookeeper.CreateMode; import org.apache.zookeeper.WatchedEvent; import org.apache.zookeeper.Watcher;

Re: Infinite ping after calling setData()

they to long to add to email at this time. Unfortunately I am having completely different issues now with the servers not shutting down. When I get past that and if I run into this issue again I will give more details. Thanks. -Original Message- From: Mahadev Konar

Re: zookeeper on ec2

Hi Satish, Connectionloss is a little trickier than just retrying blindly. Please read the following sections on this - http://wiki.apache.org/hadoop/ZooKeeper/ErrorHandling And the programmers guide: http://hadoop.apache.org/zookeeper/docs/r3.1.1/zookeeperProgrammers.html To learn more

Re: Runtime Interrogation of the Ensemble

Hi Todd, You can use jmx to to find such information. Also you can just do this Echo stat | nc localhost clientport To get status from the zookeeper servers. This is all documented in the forrest docs at http://hadoop.apache.org/zookeeper/docs/r3.1.1/zookeeperAdmin.html Hope this helps.

Re: question about watcher

Hi Qian, There isnt any such api. We have been thinking abt adding an api on cancelling a cleints watches. We have been thinking about adding a proc filesystem wherein a cleintt will have a list of all the watches. This data can be used to know which clients are watching what znode, but this has

Re: c client error message with chroot

This looks like a bug. Does this happen without doing any reads/writes using the zookeeper handle? Please do open a jira for this. Thanks mahadev On 8/2/09 10:53 PM, Michi Mutsuzaki mi...@cs.stanford.edu wrote: Hello, I'm doing something like this (using zookeeper-3.2.0): zhandle_t*

Re: bad svn url : test-patch

Hi Todd, Yes this happens with the branch 3.2. The test-patch link is broken becasuse of the hadoop split. This file is used for hudson test environment. It isnt used anywhere else, so the svn co otherwise should be fine. We should fix it anyways. Thanks mahadev On 7/30/09 2:57 PM, Todd

Bug in 3.2 release.

Hi folks, We just discovered a bug in 3.2 release http://issues.apache.org/jira/browse/ZOOKEEPER-484. This bug will affect your clients whenever they switch zookeeper servers - from a zookeeper server that is a follower to a server that is leader. We should have a fix out by next week in

Re: Leader Elections

Both of the options that Scott mentioned are quite interesting. Quite a few of our users are interested in these two features. I think for 2, we should be able to use observers with a subscription to the master cluster with interested in a special subtree. That avoids too much of cross talk.

Re: Queue code

Also are there any performance numbers of zookeeeper based queues. How does it compare with JMS. thanks Kishore G Hi Kishore, We do not have any performance number fr queues on zookeeper. I think you can get a rough idea of those numbers from your usage of zookeeper (number of reads/writes

Re: Instantiating HashSet for DataNode?

Hi Erik, I am not sure if that would a considerable opitmization but even if you wanted to do it, it would be much more than just adding a check in the constructor (the serialization/deserialization would need to have specialized code). Right now all the datanodes are treated equally for

Re: Help to compile Zookeeper C API on a old system

, 2009 at 2:22 AM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi Qian, What issues do you face? I have never tried compiling with the configuration below, but I could give it a try in my free time to see if I can get it to compile. mahadev On 7/6/09 7:37 AM, Qian Ye yeqian

Re: General Question about Zookeeper

Hi Harold, As Henry mentioned, what acl's provide you is preventing access to znodes. If someone has access to zookeeper's data stored on zookeeper's server machines, they should be able to resconstruct the data and read it (using zookeeper deserialization code). I am not sure what kind of

  1   2   >