Hi,
I was able to create a bundle by adding the following :
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-assembly-plugin</artifactId>
<version>${maven-assembly-plugin.version}</version>
<configuration>
<descriptorRefs>
<descriptorRef>jar-with-dependencies</descriptorRef>
</descriptorRefs>
</configuration>
<executions>
<execution>
<id>make-assembly</id>
<phase>package</phase>
<goals>
<goal>single</goal>
</goals>
</execution>
</executions>
</plugin>
to "pom.xml" of "gora-habse" directory and not the "root" directory.
Thanks for the help.
Regards,
Adhish
----- Original Message -----
From: "lewis john mcgibbney" <[email protected]>
To: "<[email protected]>" <[email protected]>
Sent: Friday, September 29, 2017 12:22:22 AM
Subject: Re: Using gora-hbase on AWS EMR
Hi Adhish,
You need to upgrade use of Gora dependency in Graph from 0.5 --> 0.8.
Once you have done, this, let us know the result. If you get it working
then please contribute your fix back to Graph as it is a valuable
improvement.
Thank you
On Thu, Sep 28, 2017 at 10:37 AM, <[email protected]> wrote:
>
> From: Adhish Singla <[email protected]>
> To: [email protected]
> Cc:
> Bcc:
> Date: Thu, 28 Sep 2017 23:07:05 +0530 (IST)
> Subject: Using gora-hbase on AWS EMR
> Hi all,
>
> I am trying to use Gora-HBase for I/O with Giraph-Gora on AWS EMR and this
> is the error I get :
>
> org.apache.giraph.yarn.GiraphYarnTask - GiraphYarnTask threw a top-level
> exception, failing task
> java.lang.NoClassDefFoundError: org/jdom/input/SAXBuilder
> at org.apache.gora.hbase.store.HBaseStore.readMapping(
> HBaseStore.java:729)
> at org.apache.gora.hbase.store.HBaseStore.initialize(
> HBaseStore.java:116)
> at org.apache.gora.store.DataStoreFactory.initializeDataStore(
> DataStoreFactory.java:104)
> at org.apache.gora.store.DataStoreFactory.createDataStore(
> DataStoreFactory.java:163)
> at org.apache.gora.store.DataStoreFactory.createDataStore(
> DataStoreFactory.java:120)
> at org.apache.giraph.io.gora.utils.GoraUtils.
> createDataStore(GoraUtils.java:63)
> at org.apache.giraph.io.gora.utils.GoraUtils.
> createSpecificDataStore(GoraUtils.java:87)
> at org.apache.giraph.io.gora.GoraVertexInputFormat.
> createDataStore(GoraVertexInputFormat.java:189)
> at org.apache.giraph.io.gora.GoraVertexInputFormat.
> checkInputSpecs(GoraVertexInputFormat.java:118)
> at org.apache.giraph.io.internal.WrappedVertexInputFormat.
> checkInputSpecs(WrappedVertexInputFormat.java:66)
> at org.apache.giraph.graph.GraphTaskManager.checkInput(
> GraphTaskManager.java:173)
> at org.apache.giraph.graph.GraphTaskManager.setup(
> GraphTaskManager.java:210)
> at org.apache.giraph.yarn.GiraphYarnTask.run(
> GiraphYarnTask.java:91)
> at org.apache.giraph.yarn.GiraphYarnTask.main(
> GiraphYarnTask.java:183)
> Caused by: java.lang.ClassNotFoundException: org.jdom.input.SAXBuilder
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 14 more
>
> This is probably because jdom is a dependency for gora-hbase and it is not
> included in the gora-hbase.jar .
>
> So is there a way to build gora-hbase with all its dependencies?
>
> Thanks in advance.
>
> Regards,
> Adhish
>
>
>
--
http://home.apache.org/~lewismc/
@hectorMcSpector
http://www.linkedin.com/in/lmcgibbney
