Yeah, This jar contains the I/O Formats and mappings for converting Gora Objects to Giraph Vertices/Edges and vice versa.
Regards, Adhish ----- Original Message ----- From: "Alfonso Nishikawa" <alfonso.nishik...@gmail.com> To: "<user@gora.apache.org>" <user@gora.apache.org> Sent: Thursday, September 28, 2017 11:24:08 PM Subject: Re: Using gora-hbase on AWS EMR Sorry for the spam. @Adhish: Did you execute this?: export GIRAPH_GORA_JAR=$GIRAPH_GORA_TARGET_DIR/giraph-gora-$GIRAPH_VERSION-SNAPSHOT-jar-with-dependencies.jar I never used Giraph, but that seems to configure a jar to send to the working nodes [1] (I guess). [1] - http://giraph.apache.org/gora.html Regards, Alfonso Nishikawa 2017-09-28 16:51 GMT-01:00 Adhish Singla <adhish.sin...@research.iiit.ac.in> : > Thanks, I will try the same and surely get back to you. > > Regards, > Adhish > > ----- Original Message ----- > From: "Alfonso Nishikawa" <alfonso.nishik...@gmail.com> > To: "<user@gora.apache.org>" <user@gora.apache.org> > Sent: Thursday, September 28, 2017 11:18:45 PM > Subject: Re: Using gora-hbase on AWS EMR > > Oh, I understand now :) > > How to create a bundle? Interesting question... > You can checkout the repository [1] > Then modify the pom.xml at the root [2] to add some assembly configuration > [3]. If I am not wrong there is some configuration to make it package the > dependencies. > Then just `mvn package -DskipTests` > Maybe that could work. If you find troubles tell us your advances and we > see if we can do something :) > > Thanks! > > Regards, > > Alfonso Nishikawa > > > [1] - https://github.com/apache/gora > [2] - https://github.com/apache/gora/blob/master/pom.xml > [3] - http://maven.apache.org/plugins/maven-assembly-plugin/ > > > 2017-09-28 16:42 GMT-01:00 Alfonso Nishikawa <alfonso.nishik...@gmail.com > >: > > > Hi, Adhish. > > > > Your exception seems quite strange. `HBaseStore.readMapping()` is an > > always used method, and all tests pass. At the same time, I confirm you > > that gora-hbase has the dependency jdom [1] > > > > What version of Gora are you using? > > Let's see if we find something. > > > > [1] - https://github.com/apache/gora/blob/master/gora-hbase/pom.xml#L137 > > > > Regards, > > > > Alfonso Nishikawa > > > > 2017-09-28 16:37 GMT-01:00 Adhish Singla <adhish.sin...@research.iiit. > > ac.in>: > > > >> Hi all, > >> > >> I am trying to use Gora-HBase for I/O with Giraph-Gora on AWS EMR and > >> this is the error I get : > >> > >> org.apache.giraph.yarn.GiraphYarnTask - GiraphYarnTask threw a > >> top-level exception, failing task > >> java.lang.NoClassDefFoundError: org/jdom/input/SAXBuilder > >> at org.apache.gora.hbase.store.HBaseStore.readMapping(HBaseStor > >> e.java:729) > >> at org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore > >> .java:116) > >> at org.apache.gora.store.DataStoreFactory.initializeDataStore(D > >> ataStoreFactory.java:104) > >> at org.apache.gora.store.DataStoreFactory.createDataStore(DataS > >> toreFactory.java:163) > >> at org.apache.gora.store.DataStoreFactory.createDataStore(DataS > >> toreFactory.java:120) > >> at org.apache.giraph.io.gora.utils.GoraUtils.createDataStore( > >> GoraUtils.java:63) > >> at org.apache.giraph.io.gora.utils.GoraUtils.createSpecificData > >> Store(GoraUtils.java:87) > >> at org.apache.giraph.io.gora.GoraVertexInputFormat.createDataSt > >> ore(GoraVertexInputFormat.java:189) > >> at org.apache.giraph.io.gora.GoraVertexInputFormat.checkInputSp > >> ecs(GoraVertexInputFormat.java:118) > >> at org.apache.giraph.io.internal.WrappedVertexInputFormat.check > >> InputSpecs(WrappedVertexInputFormat.java:66) > >> at org.apache.giraph.graph.GraphTaskManager.checkInput(GraphTas > >> kManager.java:173) > >> at org.apache.giraph.graph.GraphTaskManager.setup(GraphTaskMana > >> ger.java:210) > >> at org.apache.giraph.yarn.GiraphYarnTask.run(GiraphYarnTask. > >> java:91) > >> at org.apache.giraph.yarn.GiraphYarnTask.main(GiraphYarnTask. > >> java:183) > >> Caused by: java.lang.ClassNotFoundException: org.jdom.input.SAXBuilder > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > >> at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > >> at java.security.AccessController.doPrivileged(Native Method) > >> at java.net.URLClassLoader.findClass(URLClassLoader.java:354) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:425) > >> at sun.misc.Launcher$AppClassLoader.loadClass( > Launcher.java:308) > >> at java.lang.ClassLoader.loadClass(ClassLoader.java:358) > >> ... 14 more > >> > >> This is probably because jdom is a dependency for gora-hbase and it is > >> not included in the gora-hbase.jar . > >> > >> So is there a way to build gora-hbase with all its dependencies? > >> > >> Thanks in advance. > >> > >> Regards, > >> Adhish > >> > > > > >
