importing inner classes. So I think I am almost done but when I try to connect my bundle cant seem to find a class. I imported the package but it is in a inner class and I am not sure how to import that.
unable to find LoginModule class: org.apache.hadoop.security.UserGroupInformation$HadoopLoginModule is the error I am getting In my import statement should I have a * or something to get all inner classes org.apache.hadoop.security;version=1.2.1 is my import statement currently On 2015-03-25 19:32, Krzysztof Sobkowiak wrote: > There is also a recipe in Karaf Cookbook > https://github.com/jgoodyear/ApacheKarafCookbook/tree/master/chapter9/chapter-9-recipe1 > [1]. It defines a feature for Hadoop > too. It is for karaf 3.0.x (also ServiceMix 6.0.x) but it can be o good start > for you. > > regards > Krzysztof > > On 25.03.2015 20:26, Krzysztof Sobkowiak wrote: > Hi I think, Camel has a feature ready to use containing the hadoop client: > karaf@root> features:info camel-hdfs2 Description of camel-hdfs2 2.14.1 > feature ---------------------------------------------------------------- The > camel-hdfs2 feature can only run if you have libsnappyjava.dylib in > java.library.path > ---------------------------------------------------------------- Feature has > no configuration Feature has no configuration files Feature depends on: > camel-core 2.14.1 Feature contains followed bundles: > mvn:commons-lang/commons-lang/2.6 start-level=50 > mvn:com.google.guava/guava/17.0 start-level=50 > mvn:com.google.protobuf/protobuf-java/2.5.0 start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.guice/3.0_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.jsch/0.1.51_1 > start-level=50 > mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.paranamer/2.4_1 > start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.avro/1.7.3_1 start-level=50 mvn:org.apache.commons/commons-compress/1.5 start-level=50 mvn:org.apache.commons/commons-math3/3.3 start-level=50 mvn:commons-cli/commons-cli/1.2 start-level=50 mvn:commons-configuration/commons-configuration/1.9 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.commons-httpclient/3.1_7 start-level=50 mvn:io.netty/netty/3.9.4.Final start-level=50 mvn:org.codehaus.jackson/jackson-core-asl/1.9.12 start-level=50 mvn:org.codehaus.jackson/jackson-mapper-asl/1.9.12 start-level=50 mvn:org.xerial.snappy/snappy-java/1.1.0.1 start-level=50 mvn:commons-codec/commons-codec/1.9 start-level=50 mvn:commons-collections/commons-collections/3.2.1 start-level=50 mvn:commons-io/commons-io/1.4 start-level=50 mvn:commons-net/commons-net/3.3 start-level=50 mvn:org.apache.zookeeper/zookeeper/3.4.6 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlenc/0.52_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xerces/2.11.0_1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.xmlresolver/1.2_5 start-level=50 mvn:org.apache.camel/camel-hdfs2/2.14.1 start-level=50 mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.3.0_2 start-level=50 You can find the definition here https://github.com/apache/camel/blob/master/platforms/karaf/features/src/main/resources/features.xml#L625-L654 [2]. It contains all necessary dependencies (and probably some more) It contains a bit older version of hadoop client. If you are on ServiceMix, you can simply install this feature karaf@root> features:install camel-hdfs2 If you need the newer version you must build your own feature. You have probably to upgrade some other dependencies. Jean-Baptiste has also written a blog about Hadoop on Karaf and implemented some features for this: http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-karaf-as-hdfs-client/ [3]. Please ping him to check how actual this feature is. regards Krzysztof On 25.03.2015 19:14, developm...@mobigov.com wrote: Hello, I have the hadoop-core and hadoop-client bundles loading into my project. In the console I can see that they are exporting the package that I need Symbolic Name org.apache.servicemix.bundles.hadoop-client Version 2.4.1.1 Bundle Location mvn:org.apache.servicemix.bundles/org.apache.servicemix.bundles.hadoop-client/2.4.1_1 Last Modification Wed Mar 25 14:03:16 EDT 2015 Bundle Documentation http://www.apache.org/ [4] [1 [4]] Vendor The Apache Software Foundation Description This OSGi bundle wraps 2.4.1 jar files. Start Level 80 Exported Packages org.apache.hadoop,version=2.4.1 org.apache.hadoop.classification,version=2.4.1 org.apache.hadoop.classification.tools,version=2.4.1 org.apache.hadoop.conf,version=2.4.1 org.apache.hadoop.filecache,version=2.4.1 org.apache.hadoop.fs,version=2.4.1 org.apache.hadoop.fs.ftp,version=2.4.1 org.apache.hadoop.fs.local,version=2.4.1 org.apache.hadoop.fs.permission,version=2.4.1 org.apache.hadoop.fs.s3,version=2.4.1 org.apache.hadoop.fs.s3native,version=2.4.1 org.apache.hadoop.fs.shell,version=2.4.1 org.apache.hadoop.fs.viewfs,version=2.4.1 org.apache.hadoop.ha,version=2.4.1 org.apache.hadoop.ha.proto,version=2.4.1 org.apache.hadoop.ha.protocolPB,version=2.4.1 org.apache.hadoop.hdfs,version=2.4.1 If I extract the client jar I can see the class I am trying to create but when I call code that uses the class I get this exception java.lang.ClassNotFoundException: Class org.apache.hadoop.hdfs.DistributedFileSystem not found Could this be because I am missing a dependency somewhere down the line that hadoop-client has marked as optional Thanks for any help, David Daniel Links: ------ [1] http://www.apache.org/ [4] Links: ------ [1] https://github.com/jgoodyear/ApacheKarafCookbook/tree/master/chapter9/chapter-9-recipe1 [2] https://github.com/apache/camel/blob/master/platforms/karaf/features/src/main/resources/features.xml#L625-L654 [3] http://blog.nanthrax.net/2013/07/apache-hadoop-and-karaf-article-1-karaf-as-hdfs-client/ [4] http://www.apache.org/
