Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
I just provided an initial patch on ZOOKEEPER-425 to solicit some feedback. The comment in JIRA has the details. David 2009/11/11 Benjamin Reed br...@yahoo-inc.com: david, it should be pretty easy to do since we do it in our test cases. (start and stop servers.) the problem is that we haven't really exposed the interfaces. (but we have wanted to.) and we don't have tests for those non-existent exposed interfaces :) with a clean interface it should be pretty easy to get rid of the System.exits. ben dav...@apache.org wrote: Ok - I get the message :) Let me see if I can do some experimenting around running the zookeeper server in OSGi and I'll report back... David 2009/11/10 Patrick Hunt ph...@apache.org I couldn't find a JIRA for removing the sys exits so I created one: https://issues.apache.org/jira/browse/ZOOKEEPER-575 there's also this which seems like it should be easy for someone who knows osgi container jar format requirements: https://issues.apache.org/jira/browse/ZOOKEEPER-425 Now we just need to find someone who's interested and who would really like to run the server in his osgi container to work on these... (hint hint) ;-) Patrick Ted Dunning wrote: Running ZK in an OSGi container is a great idea and should be really easy to make happen. This should be a new JIRA, in my opinion. On Mon, Nov 9, 2009 at 12:10 PM, dav...@apache.org wrote: Just wondering has any progress been made on this since? I would really like to run the ZooKeeper server as a bundle in my OSGi container. Is there a JIRA to track this? If not I can create one :)
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
Ok - I get the message :) Let me see if I can do some experimenting around running the zookeeper server in OSGi and I'll report back... David 2009/11/10 Patrick Hunt ph...@apache.org I couldn't find a JIRA for removing the sys exits so I created one: https://issues.apache.org/jira/browse/ZOOKEEPER-575 there's also this which seems like it should be easy for someone who knows osgi container jar format requirements: https://issues.apache.org/jira/browse/ZOOKEEPER-425 Now we just need to find someone who's interested and who would really like to run the server in his osgi container to work on these... (hint hint) ;-) Patrick Ted Dunning wrote: Running ZK in an OSGi container is a great idea and should be really easy to make happen. This should be a new JIRA, in my opinion. On Mon, Nov 9, 2009 at 12:10 PM, dav...@apache.org wrote: Just wondering has any progress been made on this since? I would really like to run the ZooKeeper server as a bundle in my OSGi container. Is there a JIRA to track this? If not I can create one :)
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
Seriously though, if you do pick this up feel free to ping us if you have questions. 425 should be easy for you (it's just updating the build.xml afaict?) but 575 is a bit tricky. We've removed some sysexits where it's been simple, however at least one of the ones that's left is tricky - the tricky part being to ensure the server shuts down in the case of catastrophic failure (failfast). I'd love to see these two jiras go in. Thanks! Patrick dav...@apache.org wrote: Ok - I get the message :) Let me see if I can do some experimenting around running the zookeeper server in OSGi and I'll report back... David 2009/11/10 Patrick Hunt ph...@apache.org I couldn't find a JIRA for removing the sys exits so I created one: https://issues.apache.org/jira/browse/ZOOKEEPER-575 there's also this which seems like it should be easy for someone who knows osgi container jar format requirements: https://issues.apache.org/jira/browse/ZOOKEEPER-425 Now we just need to find someone who's interested and who would really like to run the server in his osgi container to work on these... (hint hint) ;-) Patrick Ted Dunning wrote: Running ZK in an OSGi container is a great idea and should be really easy to make happen. This should be a new JIRA, in my opinion. On Mon, Nov 9, 2009 at 12:10 PM, dav...@apache.org wrote: Just wondering has any progress been made on this since? I would really like to run the ZooKeeper server as a bundle in my OSGi container. Is there a JIRA to track this? If not I can create one :)
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
I couldn't find a JIRA for removing the sys exits so I created one: https://issues.apache.org/jira/browse/ZOOKEEPER-575 there's also this which seems like it should be easy for someone who knows osgi container jar format requirements: https://issues.apache.org/jira/browse/ZOOKEEPER-425 Now we just need to find someone who's interested and who would really like to run the server in his osgi container to work on these... (hint hint) ;-) Patrick Ted Dunning wrote: Running ZK in an OSGi container is a great idea and should be really easy to make happen. This should be a new JIRA, in my opinion. On Mon, Nov 9, 2009 at 12:10 PM, dav...@apache.org wrote: Just wondering has any progress been made on this since? I would really like to run the ZooKeeper server as a bundle in my OSGi container. Is there a JIRA to track this? If not I can create one :)
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
Hi all, 2009/6/2 dav...@apache.org 2009/5/29 Benjamin Reed br...@yahoo-inc.com: * The Zookeeper server is currently started with the zkServer.sh script, but I think it would make sense to also allow it to run inside an OSGi container, simply by starting a bundle. Has anyone ever done any work in this regard? If not I'm planning to spend some time and try to make this work. we have a current open jira about making it possible to embed the zookeeper server in other applications. the big problem is the System.exits that we have sprinkled around. it shouldn't be hard to make happen since we start and stop the server in our unit tests. Great - what's the JIRA number of this one so I can track it? I'm willing to help here, but it looks like there are some other issues that needs to be fixed first :) Just wondering has any progress been made on this since? I would really like to run the ZooKeeper server as a bundle in my OSGi container. Is there a JIRA to track this? If not I can create one :) Thanks, David
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
On Fri, May 29, 2009 at 10:19 AM, Mahadev Konar maha...@yahoo-inc.comwrote: Hi David, I second this. If you folks want to host at http://scala-tools.org we'd be happy to host this non-Scala but super mega interesting and valuable project. We'll even do builds on our hudson server. We have had plans to publish our release on maven repos but havent had the time to do so. If you guys have any expertise on how to publish it to apache maven repos, we'd be happy to accept and incorporate the changes. Unforetunately, I don't know how to Maven-ize Ant scripts. :-( Sorry. But if you figure out ways to enable the Ant-Maven plugin to generate pom.xml files, my offer stands to do hosting. Also, I'm hoping you guys can get something into public repositories over the next month or so. Once Goat Rodeo is something that's more than just a project for me an a few others, it'll be a huge win to have a public repository with ZK nightlies and ZK releases. mahadev * To use Zookeeper from within OSGi it has to be turned into an OSGi bundle. Doing this is not hard and it's currently done in our buildsystem [1]. However, I think it would make sense to have this done somewhere in the Zookeeper buildsystem. Matter of fact I think you should be able to release a single zookeeper.jar that's both an ordinary jar and an OSGi bundle so it would work in both cases... * The Zookeeper server is currently started with the zkServer.sh script, but I think it would make sense to also allow it to run inside an OSGi container, simply by starting a bundle. Has anyone ever done any work in this regard? If not I'm planning to spend some time and try to make this work. * BTW I made some Windows versions of the zkCli/zkEnv/zkServer scripts. Interested in taking these? Thoughts anyone? Best regards, David Bosschaert [1] http://svn.apache.org/repos/asf/cxf/dosgi/trunk/discovery/distributed/zookeep er-wrapper/pom.xml -- Lift, the simply functional web framework http://liftweb.net Beginning Scala http://www.apress.com/book/view/1430219890 Follow me: http://twitter.com/dpp Git some: http://github.com/dpp
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
you can use maven-antrun-plugin http://maven.apache.org/plugins/maven-antrun-plugin/ as a starting point first to move over to maven, then slowly make the script prettier i guess. It allows you to embed ant tasks in maven, including I think, calling out to an external build file. On Mon, Jun 22, 2009 at 2:27 PM, David Pollak feeder.of.the.be...@gmail.com wrote: On Fri, May 29, 2009 at 10:19 AM, Mahadev Konar maha...@yahoo-inc.com wrote: Hi David, I second this. If you folks want to host at http://scala-tools.orgwe'd be happy to host this non-Scala but super mega interesting and valuable project. We'll even do builds on our hudson server. We have had plans to publish our release on maven repos but havent had the time to do so. If you guys have any expertise on how to publish it to apache maven repos, we'd be happy to accept and incorporate the changes. Unforetunately, I don't know how to Maven-ize Ant scripts. :-( Sorry. But if you figure out ways to enable the Ant-Maven plugin to generate pom.xml files, my offer stands to do hosting. Also, I'm hoping you guys can get something into public repositories over the next month or so. Once Goat Rodeo is something that's more than just a project for me an a few others, it'll be a huge win to have a public repository with ZK nightlies and ZK releases. mahadev * To use Zookeeper from within OSGi it has to be turned into an OSGi bundle. Doing this is not hard and it's currently done in our buildsystem [1]. However, I think it would make sense to have this done somewhere in the Zookeeper buildsystem. Matter of fact I think you should be able to release a single zookeeper.jar that's both an ordinary jar and an OSGi bundle so it would work in both cases... * The Zookeeper server is currently started with the zkServer.sh script, but I think it would make sense to also allow it to run inside an OSGi container, simply by starting a bundle. Has anyone ever done any work in this regard? If not I'm planning to spend some time and try to make this work. * BTW I made some Windows versions of the zkCli/zkEnv/zkServer scripts. Interested in taking these? Thoughts anyone? Best regards, David Bosschaert [1] http://svn.apache.org/repos/asf/cxf/dosgi/trunk/discovery/distributed/zookeep er-wrapper/pom.xml -- Lift, the simply functional web framework http://liftweb.net Beginning Scala http://www.apress.com/book/view/1430219890 Follow me: http://twitter.com/dpp Git some: http://github.com/dpp -- Timothy Wee 612-889-1185 http://twitter.com/timwee
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
this is great to hear. it's great to see siblings playing together ;) * In CXF we use Maven to build everything. To depend on Zookeeper we need to pull it in from a Maven repository. I couldn't find Zookeeper in any main Maven repos, so currently we're pulling it in from http://people.apache.org/~chirino/zk-repo (a private repo), which is not ideal. Would there be any chance of getting the zookeeper.jar file deployed to one of the main Maven repo's (e.g. http://repo2.maven.org/maven2/)? yeah this is an increasing thorn in our side. some of us would like to convert to maven, but we are tied to the hadoop build process since we reuse all of their build/test infrastructure. we will probably be using ivy to connect to maven repositories. * To use Zookeeper from within OSGi it has to be turned into an OSGi bundle. Doing this is not hard and it's currently done in our buildsystem [1]. However, I think it would make sense to have this done somewhere in the Zookeeper buildsystem. Matter of fact I think you should be able to release a single zookeeper.jar that's both an ordinary jar and an OSGi bundle so it would work in both cases... i completely agree. please open a jira and submit a patch. * The Zookeeper server is currently started with the zkServer.sh script, but I think it would make sense to also allow it to run inside an OSGi container, simply by starting a bundle. Has anyone ever done any work in this regard? If not I'm planning to spend some time and try to make this work. we have a current open jira about making it possible to embed the zookeeper server in other applications. the big problem is the System.exits that we have sprinkled around. it shouldn't be hard to make happen since we start and stop the server in our unit tests. * BTW I made some Windows versions of the zkCli/zkEnv/zkServer scripts. Interested in taking these? excellent. please submit a jira and patch! i'm so glad you are working on this. i've been thinking for a long time that ZooKeeper would fit really well with OSGi, but i haven't had time to work on it. thank you! ben
Re: Some thoughts on Zookeeper after using it for a while in the CXF/DOSGi subproject
Hi David, I second this. If you folks want to host at http://scala-tools.org we'd be happy to host this non-Scala but super mega interesting and valuable project. We'll even do builds on our hudson server. We have had plans to publish our release on maven repos but havent had the time to do so. If you guys have any expertise on how to publish it to apache maven repos, we'd be happy to accept and incorporate the changes. mahadev * To use Zookeeper from within OSGi it has to be turned into an OSGi bundle. Doing this is not hard and it's currently done in our buildsystem [1]. However, I think it would make sense to have this done somewhere in the Zookeeper buildsystem. Matter of fact I think you should be able to release a single zookeeper.jar that's both an ordinary jar and an OSGi bundle so it would work in both cases... * The Zookeeper server is currently started with the zkServer.sh script, but I think it would make sense to also allow it to run inside an OSGi container, simply by starting a bundle. Has anyone ever done any work in this regard? If not I'm planning to spend some time and try to make this work. * BTW I made some Windows versions of the zkCli/zkEnv/zkServer scripts. Interested in taking these? Thoughts anyone? Best regards, David Bosschaert [1] http://svn.apache.org/repos/asf/cxf/dosgi/trunk/discovery/distributed/zookeep er-wrapper/pom.xml