Hi I think, Camel has a feature ready to use containing the hadoop client:
karaf@root> features:info camel-hdfs2 Description of camel-hdfs2 2.14.1 feature ---------------------------------------------------------------- The camel-hdfs2 feature can only run if you have libsnappyjava.dylib in java.library.path ---------------------------------------------------------------- Feature has no configuration Feature has no configuration files Feature depends on: camel-core 2.14.1 Feature contains followed bundles: mvn:commons-lang/commons-lang/2.6 start-level=50 mvn:com.google.guava/guava/17.0 start-level=50 mvn:com.google.protobuf/protobuf-java/2.5.0 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.guice/3.0_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.jsch/0.1.51_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.paranamer/2.4_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.avro/1.7.3_1 start-level=50 mvn:org.apache.commons/commons-compress/1.5 start-level=50 mvn:org.apache.commons/commons-math3/3.3 start-level=50 mvn:commons-cli/commons-cli/1.2 start-level=50 mvn:commons-configuration/commons-configuration/1.9 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.commons-httpclient/3.1_7 start-level=50 mvn:io.netty/netty/3.9.4.Final start-level=50 mvn:org.codehaus.jackson/jackson-core-asl/1.9.12 start-level=50 mvn:org.codehaus.jackson/jackson-mapper-asl/1.9.12 start-level=50 mvn:org.xerial.snappy/snappy-java/1.1.0.1 start-level=50 mvn:commons-codec/commons-codec/1.9 start-level=50 mvn:commons-collections/commons-collections/3.2.1 start-level=50 mvn:commons-io/commons-io/1.4 start-level=50 mvn:commons-net/commons-net/3.3 start-level=50 mvn:org.apache.zookeeper/zookeeper/3.4.6 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlenc/0.52_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xerces/2.11.0_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlresolver/1.2_5 start-level=50 mvn:org.apache.camel/camel-hdfs2/2.14.1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.3.0_2 start-level=50 You can find the definition here https://github.com/apache/camel/blob/master/platforms/karaf/features/src/main/resources/features.xml#L625-L654. It contains all necessary dependencies (and probably some more) It contains a bit older version of hadoop client. If you are on ServiceMix, you can simply install this feature karaf@root> features:install camel-hdfs2 If you need the newer version you must build your own feature. You have probably to upgrade some other dependencies. Jean-Baptiste has also written a blog about Hadoop on Karaf and implemented some features for this: http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-karaf-as-hdfs-client/. Please ping him to check how actual this feature is. regards Krzysztof On 25.03.2015 19:14, developm...@mobigov.com wrote: > > > Hello, > > I have the hadoop-core and hadoop-client bundles loading into my > project. In the console I can see that they are exporting the package > that I need > > Symbolic Name > org.apache.servicemix.bundles.hadoop-client > > Version > 2.4.1.1 > > Bundle Location > > > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.4.1_1 > > Last Modification > Wed Mar 25 14:03:16 EDT 2015 > > Bundle Documentation > http://www.apache.org/ [1] > > Vendor > The Apache Software Foundation > > Description > This OSGi bundle wraps 2.4.1 jar files. > > Start Level > 80 > > Exported Packages > org.apache.hadoop,version=2.4.1 > org.apache.hadoop.classification,version=2.4.1 > org.apache.hadoop.classification.tools,version=2.4.1 > org.apache.hadoop.conf,version=2.4.1 > org.apache.hadoop.filecache,version=2.4.1 > org.apache.hadoop.fs,version=2.4.1 > org.apache.hadoop.fs.ftp,version=2.4.1 > org.apache.hadoop.fs.local,version=2.4.1 > org.apache.hadoop.fs.permission,version=2.4.1 > org.apache.hadoop.fs.s3,version=2.4.1 > org.apache.hadoop.fs.s3native,version=2.4.1 > org.apache.hadoop.fs.shell,version=2.4.1 > org.apache.hadoop.fs.viewfs,version=2.4.1 > org.apache.hadoop.ha,version=2.4.1 > org.apache.hadoop.ha.proto,version=2.4.1 > org.apache.hadoop.ha.protocolPB,version=2.4.1 > org.apache.hadoop.hdfs,version=2.4.1 > > If I extract the client jar I can see the class I am trying to create > but when I call code that uses the class I get this exception > > java.lang.ClassNotFoundException: Class > org.apache.hadoop.hdfs.DistributedFileSystem not found > > Could this be because I am missing a dependency somewhere down the line > that hadoop-client has marked as optional > > Thanks for any help, > > David Daniel > > > Links: > ------ > [1] http://www.apache.org/ > -- Krzysztof Sobkowiak JEE & OSS Architect Senior Solution Architect @ Capgemini SSC <http://www.pl.capgemini-sdm.com/en> Apache ServiceMix <http://servicemix.apache.org/> Committer & PMC
