Great. Thank you. I am just wondering. How is building GORA will help with anything in my situation? probably not, right? it doesn't seem I need to use any of the built.
It seems GORA already included in the SOLR 2.X and HBASE .98.9 release. Is this a correct assumption? Thank you. Tom On Sat, Feb 20, 2016 at 1:35 AM, Lewis John Mcgibbney < lewis.mcgibb...@gmail.com> wrote: > Hi Tom, > All you need to do is ensure that gora-hbase dependency is uncommented > within $NUTCH_HOME/ivy/ivy.xml > https://github.com/apache/nutch/blob/2.x/ivy/ivy.xml#L116 > > You then need to ensure that that the storage.data.store.class is correct > in $NUTCH_HOME/conf/nutch-default.xml. This needs to be set to > 'org.apache.gora.hbase.store.HBaseStore' > https://github.com/apache/nutch/blob/2.x/conf/nutch-default.xml#L1333-L1371 > > Finally, you need to configure $NUTCH_HOME/conf/gora.properties > https://github.com/apache/nutch/blob/2.x/conf/gora.properties > Make sure that the correct gora-hbase configuration is included. > > That is all you need to do. > Lewis > > On Fri, Feb 19, 2016 at 10:29 PM, Tom Running <runningt...@gmail.com> > wrote: > >> Furkan, >> >> What you had mention is exactly what I am trying to accomplish. >> > Using Nutch to crawl websites and storing them at Hbase and indexing at >> Solr via Gora? >> >> >> I need a bit more help to ensure what I am about to do is correct.. >> >> #1. >> after successfully build GORA. I have the following two .jar files in >> /gora/gora-solr/lib/ directory. Lot of .jar files in the /lib directory >> but only two .jar files relative to solr. >> solr-solrj-4.10.3.jar >> solr-core-4.10.3.jar >> >> >> #2. >> In the solr source distribution directory I have also see the same exact >> .jar files. This is a source code download. I have not build this solr >> yet. >> >> /home/solr/dist >> solr-solrj-4.10.3.jar >> solr-core-4.10.3.jar >> solr-4.10.3.war >> >> >> My question is. Should I copy the two solr files in #1 to >> /home/solr/dist/ then build solr? >> >> >> #3. >> Should I also do the same thing for hbase. Copy the >> /gora/gora-hbase/lib/hbase-* into /hbase/lib/ then build hbase? >> >> >> >> Thank you. >> Tom >> >> On Wed, Feb 17, 2016 at 5:31 PM, Furkan KAMACI <furkankam...@gmail.com> >> wrote: >> >>> Hi Tom, >>> >>> What do you aim? Using Nutch to crawl websites and storing them at Hbase >>> and indexing at Solr via Gora? Do you have any other use cases? >>> >>> "Simply", you may think that Gora will act as Hibernate of NoSQL >>> ecosystem at your use case. So, it will not run as a service, it will be a >>> dependency. >>> >>> Kind Regards, >>> Furkan KAMACI >>> 17 Şub 2016 22:13 tarihinde "Lewis John Mcgibbney" < >>> lewis.mcgibb...@gmail.com> yazdı: >>> >>> Hi Tom, >>>> You can just follow the following tutorial >>>> http://wiki.apache.org/nutch/Nutch2Tutorial >>>> Replacing the gora-hbase configuration from within your Nutch >>>> conf/nutch-default.xml and conf/gora.properties and with the relevant >>>> dependency from within ivy/ivy.xml with the gora-solr equivalent. >>>> Any more issues then please let us know. Gora does not run as a service >>>> no, it is a dependency and is managed through your client dependency >>>> manager (which in Nutch 2.X is Ivy). >>>> Thanks >>>> >>>> On Wed, Feb 17, 2016 at 12:04 PM, Tom Running <runningt...@gmail.com> >>>> wrote: >>>> >>>>> Furkan and Lewis, >>>>> >>>>> Thank you for your response to my SOS. I tried varies suggestion on >>>>> editing pom.xlm file and including down grade the java JDK version to 1.7 >>>>> and removed the .m2 folder and run mvn clean install again and it >>>>> build successfully. >>>>> >>>>> Now Gora is successfully build. I am trying to understand how to get >>>>> Gora run or start in order get the following three packages to work >>>>> together Nutch, Solr and Hbase with GORA >>>>> Does Gora start as a service? >>>>> Or >>>>> To get other three packages to work with GORA I will need to copy the >>>>> *.jar to the three packages (Nutch, Solr and Hbase) lib folder? >>>>> >>>>> >>>>> *I am a bit confuse on how to get these packages to work with GORA. I >>>>> had read GORA's quickstart guide but am still not too clear on what to >>>>> do.* >>>>> >>>>> >>>>> *Can you provide some direction.* >>>>> >>>>> *Thank you.* >>>>> >>>>> *Tom* >>>>> >>>>> On Wed, Feb 17, 2016 at 1:56 PM, Furkan KAMACI <furkankam...@gmail.com >>>>> > wrote: >>>>> >>>>>> Hi Tom, >>>>>> >>>>>> It seems that your maven is at offline mode. There may be a problem >>>>>> with your settings.xml or environment variable for maven home. How do you >>>>>> build your project? Could you build it with -X option and send the >>>>>> output? >>>>>> >>>>>> Kind Regards, >>>>>> Furkan KAMACI >>>>>> 17 Şub 2016 20:51 tarihinde "Tom Running" <runningt...@gmail.com> >>>>>> yazdı: >>>>>> >>>>>> What to do with the error below. >>>>>> >>>>>> >>>>>> [INFO] Building Apache Gora :: Accumulo 0.6.1 >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [WARNING] The POM for org.apache.accumulo:accumulo-core:jar:1.5.1 is >>>>>> missing, no dependency information available >>>>>> [WARNING] The POM for >>>>>> org.apache.accumulo:accumulo-minicluster:jar:1.5.1 is missing, no >>>>>> dependency information available >>>>>> [WARNING] The POM for org.jboss.netty:netty:jar:3.2.2.Final is >>>>>> missing, no dependency information available >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [INFO] Reactor Summary: >>>>>> [INFO] >>>>>> [INFO] Apache Gora ........................................ SUCCESS >>>>>> [ 1.468 s] >>>>>> [INFO] Apache Gora :: Compiler ............................ SUCCESS >>>>>> [ 0.121 s] >>>>>> [INFO] Apache Gora :: Compiler-CLI ........................ SUCCESS >>>>>> [ 0.032 s] >>>>>> [INFO] Apache Gora :: Shims Hadoop ........................ SUCCESS >>>>>> [ 0.543 s] >>>>>> [INFO] Apache Gora :: Shims Hadoop 1.x .................... SUCCESS >>>>>> [ 0.190 s] >>>>>> [INFO] Apache Gora :: Shims Hadoop 2.x .................... SUCCESS >>>>>> [ 0.295 s] >>>>>> [INFO] Apache Gora :: Shims Distribution .................. SUCCESS >>>>>> [ 0.026 s] >>>>>> [INFO] Apache Gora :: Core ................................ SUCCESS >>>>>> [ 0.806 s] >>>>>> [INFO] Apache Gora :: Accumulo ............................ FAILURE >>>>>> [ 0.120 s] >>>>>> [INFO] Apache Gora :: Cassandra ........................... SKIPPED >>>>>> [INFO] Apache Gora :: GoraCI .............................. SKIPPED >>>>>> [INFO] Apache Gora :: HBase ............................... SKIPPED >>>>>> [INFO] Apache Gora :: MongoDB ............................. SKIPPED >>>>>> [INFO] Apache Gora :: Solr ................................ SKIPPED >>>>>> [INFO] Apache Gora :: Tutorial ............................ SKIPPED >>>>>> [INFO] Apache Gora :: Sources-Dist ........................ SKIPPED >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [INFO] BUILD FAILURE >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [INFO] Total time: 6.359 s >>>>>> [INFO] Finished at: 2016-02-17T02:00:39-05:00 >>>>>> [INFO] Final Memory: 25M/61M >>>>>> [INFO] >>>>>> ------------------------------------------------------------------------ >>>>>> [ERROR] Failed to execute goal on project gora-accumulo: Could not >>>>>> resolve dependencies for project >>>>>> org.apache.gora:gora-accumulo:bundle:0.6.1: The following artifacts could >>>>>> not be resolved: org.apache.gora:gora-core:jar:0.6.1, >>>>>> org.apache.gora:gora-core:jar:tests:0.6.1, >>>>>> org.apache.accumulo:accumulo-core:jar:1.5.1, >>>>>> org.apache.accumulo:accumulo-minicluster:jar:1.5.1, >>>>>> jline:jline:jar:0.9.1, >>>>>> org.jboss.netty:netty:jar:3.2.2.Final, >>>>>> org.codehaus.jackson:jackson-jaxrs:jar:1.8.3, >>>>>> org.codehaus.jackson:jackson-xc:jar:1.8.3: Cannot access central ( >>>>>> https://repo.maven.apache.org/maven2) in offline mode and the >>>>>> artifact org.apache.gora:gora-core:jar:0.6.1 has not been downloaded from >>>>>> it before. -> [Help 1] >>>>>> [ERROR] >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> *Lewis* >>>> >>> >> > > > -- > *Lewis* >
