yeah that is where I stole most of my stuff from.
This link http://repo1.maven.org/maven2/org/apache/camel/karaf/apache-camel/2.13.2/apache-camel-2.13.2-features.xml uses hadoop-core though and when I combined both of them is when I got myself in trouble. Thank you for your help. David Daniel On 2015-03-25 19:26, Krzysztof Sobkowiak wrote: > Hi > > I think, Camel has a feature ready to use containing the hadoop client: > > karaf@root> features:info camel-hdfs2 > Description of camel-hdfs2 2.14.1 feature > ---------------------------------------------------------------- > The camel-hdfs2 feature can only run if you have libsnappyjava.dylib in > java.library.path > ---------------------------------------------------------------- > Feature has no configuration > Feature has no configuration files > Feature depends on: > camel-core 2.14.1 > Feature contains followed bundles: > mvn:commons-lang/commons-lang/2.6 start-level=50 > mvn:com.google.guava/guava/17.0 start-level=50 > mvn:com.google.protobuf/protobuf-java/2.5.0 start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.guice/3.0_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.jsch/0.1.51_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.paranamer/2.4_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.avro/1.7.3_1 > start-level=50 > mvn:org.apache.commons/commons-compress/1.5 start-level=50 > mvn:org.apache.commons/commons-math3/3.3 start-level=50 > mvn:commons-cli/commons-cli/1.2 start-level=50 > mvn:commons-configuration/commons-configuration/1.9 start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.commons-httpclient/3.1_7 > start-level=50 > mvn:io.netty/netty/3.9.4.Final start-level=50 > mvn:org.codehaus.jackson/jackson-core-asl/1.9.12 start-level=50 > mvn:org.codehaus.jackson/jackson-mapper-asl/1.9.12 start-level=50 > mvn:org.xerial.snappy/snappy-java/1.1.0.1 start-level=50 > mvn:commons-codec/commons-codec/1.9 start-level=50 > mvn:commons-collections/commons-collections/3.2.1 start-level=50 > mvn:commons-io/commons-io/1.4 start-level=50 > mvn:commons-net/commons-net/3.3 start-level=50 > mvn:org.apache.zookeeper/zookeeper/3.4.6 start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlenc/0.52_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xerces/2.11.0_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlresolver/1.2_5 > start-level=50 > mvn:org.apache.camel/camel-hdfs2/2.14.1 start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.3.0_2 > start-level=50 > > You can find the definition here > https://github.com/apache/camel/blob/master/platforms/karaf/features/src/main/resources/features.xml#L625-L654 > [2]. It > contains all necessary dependencies (and probably some more) > It contains a bit older version of hadoop client. If you are on ServiceMix, > you can simply install this feature > > karaf@root> features:install camel-hdfs2 > > If you need the newer version you must build your own feature. You have > probably to upgrade some other dependencies. > > Jean-Baptiste has also written a blog about Hadoop on Karaf and implemented > some features for this: > http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-karaf-as-hdfs-client/ > [3]. Please ping him to check how > actual this feature is. > > regards > Krzysztof > > On 25.03.2015 19:14, developm...@mobigov.com wrote: > >> Hello, I have the hadoop-core and hadoop-client bundles loading into my >> project. In the console I can see that they are exporting the package that I >> need Symbolic Name org.apache.servicemix.bundles.hadoop-client Version >> 2.4.1.1 Bundle Location >> mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.4.1_1 >> Last Modification Wed Mar 25 14:03:16 EDT 2015 Bundle Documentation >> http://www.apache.org/ [1] [1 [1]] Vendor The Apache Software Foundation >> Description This OSGi bundle wraps 2.4.1 jar files. Start Level 80 Exported >> Packages org.apache.hadoop,version=2.4.1 >> org.apache.hadoop.classification,version=2.4.1 >> org.apache.hadoop.classification.tools,version=2.4.1 >> org.apache.hadoop.conf,version=2.4.1 >> org.apache.hadoop.filecache,version=2.4.1 org.apache.hadoop.fs,version=2.4.1 >> org.apache.hadoop.fs.ftp,version=2.4.1 >> org.apache.hadoop.fs.local,version=2.4.1 >> org.apache.hadoop.fs.permission,version=2.4.1 >> org.apache.hadoop.fs.s3,version=2.4.1 org.apache.hadoop.fs.s3native,version=2.4.1 org.apache.hadoop.fs.shell,version=2.4.1 org.apache.hadoop.fs.viewfs,version=2.4.1 org.apache.hadoop.ha,version=2.4.1 org.apache.hadoop.ha.proto,version=2.4.1 org.apache.hadoop.ha.protocolPB,version=2.4.1 org.apache.hadoop.hdfs,version=2.4.1 If I extract the client jar I can see the class I am trying to create but when I call code that uses the class I get this exception java.lang.ClassNotFoundException: Class org.apache.hadoop.hdfs.DistributedFileSystem not found Could this be because I am missing a dependency somewhere down the line that hadoop-client has marked as optional Thanks for any help, David Daniel Links: ------ [1] http://www.apache.org/ [1] Links: ------ [1] http://www.apache.org/ [2] https://github.com/apache/camel/blob/master/platforms/karaf/features/src/main/resources/features.xml#L625-L654 [3] http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-karaf-as-hdfs-client/
