Re: Accumulo and OSGi

2014-04-23 Thread Geoffry Roberts
I thought I'd check in. After some encouragement from this group, I found some time and now have an Accumulo client running in OSGi (Felix). It's rather primitive, at this juncture, in that it is little more than a wrap job. I was, however, forced to hack Zookeeper to get things to work.

Re: Accumulo and OSGi

2014-04-23 Thread Mike Drob
Geoffry, Fixing our logging libraries is an open issue - https://issues.apache.org/jira/browse/ACCUMULO-1242 I hope to see it resolved soon. It's a pretty big task, so if you feel inspired to help, it would be appreciated as well! Thanks, Mike On Wed, Apr 23, 2014 at 9:39 AM, Geoffry Roberts

Re: Accumulo and OSGi

2014-04-23 Thread Sean Busbey
yes, there are also some bits using commons-logging. I think we managed to scrub out java.util.logging. On Wed, Apr 23, 2014 at 8:39 AM, Geoffry Roberts threadedb...@gmail.comwrote: I thought I'd check in. After some encouragement from this group, I found some time and now have an Accumulo

Re: Accumulo and OSGi

2014-04-23 Thread Geoffry Roberts
If I were to pitch in on this, how would it work? and what logger? Do I submit patches? Is slf4j the target? On Wed, Apr 23, 2014 at 9:45 AM, Sean Busbey bus...@cloudera.com wrote: yes, there are also some bits using commons-logging. I think we managed to scrub out java.util.logging.

Re: Accumulo and OSGi

2014-04-23 Thread Josh Elser
I'd love to see us move to slf4j. Hadoop is in the middle of a proposal about this too which sounds good to me. http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201404.mbox/%3CCA%2B4kjVv7N2dRR5rmdFHCpBx-K3yT7YRLs0Dvrvdjsn3iChUsEA%40mail.gmail.com%3E On 4/23/14, 10:33 AM, Geoffry

Re: Accumulo and OSGi

2014-04-10 Thread Geoffry Roberts
I might be interested in taking on the work. Can you help me find your patch? I have a code base already in OSGi that works with MongoDB. I need to point it at Accumulo instead, and if I can do so without porting out of OSGi that would be nice. You say the community would be well-accepting of

Re: Accumulo and OSGi

2014-04-09 Thread Corey Nolet
Geoffry, As Josh pointed out, you should only need the Hadoop libraries on the client side to use the Text object. This means you won't have to go through the pain of placing the xml files in your root bundles. Did you try the JAAS export from the packages in your container? Did that help? I

Re: Accumulo and OSGi

2014-04-09 Thread Geoffry Roberts
Corey, Interesting you have Hadoop working in Karaf. I'm using equinox. It also sounds as if I don't need to access HFDS in order to get Accumulo to work in OSGi. If I understand you correctly, I only need have Text available. I'll look into that. It does answer my question and maybe I can

Re: Accumulo and OSGi

2014-04-09 Thread Corey Nolet
Geoffry, Interesting you have Hadoop working in Karaf. I'm using equinox. Sure, but are we talking Karaf-specific features here? You just want a Hadoop Client bundle that works, right? The author of the Karaf-Hadoop project already worked through the classpath issues so it's not a bad starting

Re: Accumulo and OSGi

2014-04-07 Thread Geoffry Roberts
Thanks Corey, I appreciate your insights wrt the internal nature of the Hadoop Client. I hadn't yet opened it up. Ideally, we should be able to use these things as black boxes, or so the theory goes. Nevertheless, I'll look into your notes. My original question remains: Is the Accumulo Client

Re: Accumulo and OSGi

2014-04-07 Thread Geoffry Roberts
Ahh, let me try and address where I might have gone off the linguistic reservation. bndtools -- is an eclipse plugin that is very helpful when developing OSGi bundles. It does a lot of grimy, boilerplate things for you. inlining -- is where one places dependent *.jar files inside the OSGi

Re: Accumulo and OSGi

2014-04-06 Thread Geoffry Roberts
All, To what extent does the Accumulo Client rely on the Hadoop Client? I apologize if the question is a bit obtuse. But I got into dependency weeds trying to get the Hadoop Client to work in OSGI. (See below Hadoop Client woes) I am now wondering if I OSGified Accumulo's client would I

Re: Accumulo and OSGi

2014-04-06 Thread Corey Nolet
Geoffrey, My quick answer is that I needed to adjust my container (Karaf in my case) to export the JAAS packages because they come in the JRE. Then I needed to make the hadoop bundle import them. Also before I forget, Hadoop packages its default xml configurations (core-site.xml,

Re: Accumulo and OSGi

2014-04-01 Thread Geoffry Roberts
Thank you Corey, I was unaware of the service mix Hadoop client. It's funny that no one on the Hadoop list ever mentioned it. You say you have 1.4 working in OSGi. Did you do a proper port or just wrap it with something like bnd? I have Hadoop 2.3.0 so I need to use Accumulo 1.5.1. I'm glad

Re: Accumulo and OSGi

2014-03-31 Thread Luk Vervenne
osgi... see wso2.com On 31 Mar 2014, at 16:58, Geoffry Roberts threadedb...@gmail.com wrote: All, I have a project for which Accumulo it appears will serve well. However, I have a significant amount of code I want to leverage that runs in OSGi. I don't need for Accumulo itself to be

Re: Accumulo and OSGi

2014-03-31 Thread Josh Elser
Corey has made a ticket[1] for Accumulo 1.7.0. Not sure if he's planning to do the work or if he just wanted to get it down on paper. There's also been work done[2] to make sure the Accumulo client cleans up after itself (or at least you have the ability to force a clean up). That will help

Re: Accumulo and OSGi

2014-03-31 Thread Corey Nolet
Geoffry, What OSGi container are you using currently? The servicemix Hadoop bundle should get you going with the Hadoop client dependencies at least [1]. It looks like one of the servicemix guys created a Hadoop ticket for making bundles of their jars as well [2], though it doesn't look like