Re: Modify ZooKeeper Java client to hold weak references to Watcher objects

2010-03-22 Thread Dominic Williams
Quite a few platforms make the specification of weak listeners explicit e.g. in ActionScript you can specify a boolean in addEventListener that specifies whether the event source should hold weak references to listeners. Therefore I think whether you want an event source to hold a weak or strong re

A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Dominic Williams
Hi all, I'm developing a library of primitives backed by ZooKeeper. An issue I've recently hit is that you can only add children to persistent nodes. When you're creating primitives for things like locking - for use for exampe synchronizing cluster-wide processing of a NOSQL database like Cassand

[jira] Created: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly. --- Key: ZOOKEEPER-722 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-722 Project: Zookeeper Issue Type: Bug

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated ZOOKEEPER-722: - Attachment: zk-722.diff Fix by making zk use the echo executable directly when -n in use. > z

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated ZOOKEEPER-722: - Release Note: Fix zkServer.sh script for BSD systems. Status: Patch Available (was:

[jira] Commented: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848157#action_12848157 ] Hadoop QA commented on ZOOKEEPER-722: - -1 overall. Here are the results of testing

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Lei Zhang
Hi Dominic, Is it acceptable to use ephemeral nodes with hierarchical names, such as "starburst.cluster.nodes"?

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Patrick Hunt
Hi Lei, that's perfectly fine, however the issue would be that operations such as "getchildren(/path)" would return all these, vs if you had an explicit path structure such as getchildren(/path/starburst/cluster/nodes) - ie flat vs hierarchical. Patrick Lei Zhang wrote: Hi Dominic, Is it ac

[jira] Commented: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848202#action_12848202 ] Henry Robinson commented on ZOOKEEPER-722: -- Hi Ivan - Thanks for the patch -

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Patrick Hunt
Dominic Williams wrote: 1/ If a node crashes or something else goes wrong, you leave behind persistent nodes. Over time these will grow and grow, rather like the old tmp folders used to fill with files under Windows That's true. One either needs to use ephemerals or use persistent and have a "

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated ZOOKEEPER-722: - Attachment: zk-722.diff > zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly. > --

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated ZOOKEEPER-722: - Status: In Progress (was: Patch Available) > zkServer.sh uses sh's builtin echo on BSD, behav

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated ZOOKEEPER-722: - Attachment: (was: zk-722.diff) > zkServer.sh uses sh's builtin echo on BSD, behaves incorr

[jira] Commented: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848209#action_12848209 ] Ivan Kelly commented on ZOOKEEPER-722: -- Hi Henry, I had assumed it used -p1, I've

Re: Modify ZooKeeper Java client to hold weak references to Watcher objects

2010-03-22 Thread Patrick Hunt
Would "WeakWatcher", a proxy watcher that holds a weak reference to the proxied watcher, not also solve this with minimal overhead? You could do this today. 1/ Add a useWeakReferences parameter to new constructor (sets default behaviour) 2/ Add alternative methods, which take useWeakWatcherRef

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Dominic Williams
Hi Patrick, This is a little more complex than I'd initially given consideration to. The biggest point being the question about what would happen to an ephemeral parent node when the session that owns it exits. What I'd suggest might work: - when the session that created the parent ends, ownershi

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Patrick Hunt
Dominic Williams wrote: What I'd suggest might work: - when the session that created the parent ends, ownership of the parent could either be transferred to the owner/session that created the oldest child, or instead ownership could be transferred to some kind of nominal system session (which wo

Begin a discussion about ZooKeeper as a top level project

2010-03-22 Thread Patrick Hunt
You have probably heard by now that there is a discussion going on in the Hadoop PMC as to whether a number of the subprojects (Hbase, Avro, Zookeeper, Hive, and Pig) should move out from under the Hadoop umbrella and become top level Apache projects (TLP). This discussion has picked up recently s

[jira] Updated: (ZOOKEEPER-720) Use zookeeper-{version}-sources.jar instead of zookeeper-{version}-src.jar to publish sources in the Maven repository

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated ZOOKEEPER-720: - Hadoop Flags: [Reviewed] > Use zookeeper-{version}-sources.jar instead of zookeeper-{v

[jira] Commented: (ZOOKEEPER-720) Use zookeeper-{version}-sources.jar instead of zookeeper-{version}-src.jar to publish sources in the Maven repository

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848290#action_12848290 ] Henry Robinson commented on ZOOKEEPER-720: -- Patch looks good to me, +1. > Use

Re: Modify ZooKeeper Java client to hold weak references to Watcher objects

2010-03-22 Thread Dominic Williams
On 22 March 2010 16:59, Patrick Hunt wrote: > Would "WeakWatcher", a proxy watcher that holds a weak reference to the > proxied watcher, not also solve this with minimal overhead? You could do > this today. > > Hi, Yup a WeakWatcher would certainly provide an interim solution. > > 1/ Add a us

[jira] Commented: (ZOOKEEPER-703) GSoC 2010: ZooKeeper DNS Server

2010-03-22 Thread Florian Moga (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848315#action_12848315 ] Florian Moga commented on ZOOKEEPER-703: I am a GSoC applicant and I find this p

[jira] Commented: (ZOOKEEPER-703) GSoC 2010: ZooKeeper DNS Server

2010-03-22 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848328#action_12848328 ] Mahadev konar commented on ZOOKEEPER-703: - florian, http://hadoop.apache.org/zo

[jira] Assigned: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt reassigned ZOOKEEPER-722: -- Assignee: Ivan Kelly > zkServer.sh uses sh's builtin echo on BSD, behaves incorrectl

[jira] Assigned: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson reassigned ZOOKEEPER-722: Assignee: Ivan Kelly (was: Henry Robinson) Assigning back to Ivan after I gave

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson updated ZOOKEEPER-722: - Status: Patch Available (was: In Progress) > zkServer.sh uses sh's builtin echo on BS

[jira] Assigned: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Henry Robinson (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Robinson reassigned ZOOKEEPER-722: Assignee: Henry Robinson (was: Ivan Kelly) > zkServer.sh uses sh's builtin echo

[jira] Updated: (ZOOKEEPER-464) Need procedure to garbage collect ledgers

2010-03-22 Thread Erwin Tam (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erwin Tam updated ZOOKEEPER-464: Assignee: Erwin Tam I'm working on this enhancement now and just about ready to submit this as a

[jira] Updated: (ZOOKEEPER-720) Use zookeeper-{version}-sources.jar instead of zookeeper-{version}-src.jar to publish sources in the Maven repository

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-720: --- Affects Version/s: (was: 3.0.0) 3.3.0 > Use zookeeper-{version}

[jira] Updated: (ZOOKEEPER-720) Use zookeeper-{version}-sources.jar instead of zookeeper-{version}-src.jar to publish sources in the Maven repository

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-720: --- Fix Version/s: 3.4.0 Assignee: Paolo Castagna > Use zookeeper-{version}-sources.j

[jira] Updated: (ZOOKEEPER-721) No set for log4j dependency in the generated pom.xml

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-721: --- Affects Version/s: (was: 3.3.1) (was: 3.0.0)

[jira] Commented: (ZOOKEEPER-720) Use zookeeper-{version}-sources.jar instead of zookeeper-{version}-src.jar to publish sources in the Maven repository

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848417#action_12848417 ] Patrick Hunt commented on ZOOKEEPER-720: once 3.3.0 goes out officially we shoul

[jira] Updated: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-722: --- Affects Version/s: 3.3.0 Fix Version/s: 3.4.0 3.3.1 > zkSer

[jira] Commented: (ZOOKEEPER-722) zkServer.sh uses sh's builtin echo on BSD, behaves incorrectly.

2010-03-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848418#action_12848418 ] Hadoop QA commented on ZOOKEEPER-722: - -1 overall. Here are the results of testing

[jira] Commented: (ZOOKEEPER-719) Add throttling to BookKeeper client

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12848420#action_12848420 ] Patrick Hunt commented on ZOOKEEPER-719: Is this really a bug or improvement? If

[jira] Updated: (ZOOKEEPER-719) Add throttling to BookKeeper client

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-719: --- Affects Version/s: 3.3.0 Fix Version/s: 3.4.0 > Add throttling to BookKeeper clien

[jira] Updated: (ZOOKEEPER-714) snapshotting doesn't handle runtime exceptions (like out of memory) well

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-714: --- Fix Version/s: 3.4.0 > snapshotting doesn't handle runtime exceptions (like out of memory)

[jira] Updated: (ZOOKEEPER-715) add better reporting for initLimit being reached

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-715: --- Fix Version/s: 3.4.0 > add better reporting for initLimit being reached >

[jira] Updated: (ZOOKEEPER-706) large numbers of watches can cause session re-establishment to fail

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-706: --- Fix Version/s: 3.4.0 > large numbers of watches can cause session re-establishment to fail

[jira] Updated: (ZOOKEEPER-707) c client close can crash with cptr null

2010-03-22 Thread Patrick Hunt (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Hunt updated ZOOKEEPER-707: --- Fix Version/s: 3.4.0 > c client close can crash with cptr null > -

Re: Begin a discussion about ZooKeeper as a top level project

2010-03-22 Thread Benjamin Reed
pat, i think you articulated well the problems with becoming a TLP. you don't seem to have voted for one of the options though :) i guess my view corresponds to option 2). it does seem like a good idea in the long term for ZooKeeper to become its own project, but for the near term, for the rea

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Benjamin Reed
let me put out an idea that we have kicked around for a while: ephemeral containers. the idea is that the znode disappears if it doesn't have children. you would create the znode with create("/path", data, acl, EPHEMERAL_CONTAINER) this would result in the creation two znodes: /path and /path/c

Re: A deficiency? You can only add children to persistent nodes

2010-03-22 Thread Jeff Hammerbacher
Hey Ben, Perhaps you should open a JIRA for further discussion? Thanks, Jeff On Mon, Mar 22, 2010 at 7:42 PM, Benjamin Reed wrote: > let me put out an idea that we have kicked around for a while: ephemeral > containers. the idea is that the znode disappears if it doesn't have > children. you w