Re: GORA build problem.

[Tom Running]

Great. Thank you.

I am just wondering.  How is building GORA will help with anything in my
situation?  probably not, right? it doesn't seem I need to use any of the
built.

It seems GORA already included in the SOLR 2.X and HBASE .98.9 release.
Is this a correct assumption?

Thank you.
Tom

On Sat, Feb 20, 2016 at 1:35 AM, Lewis John Mcgibbney <
lewis.mcgibb...@gmail.com> wrote:

> Hi Tom,
> All you need to do is ensure that gora-hbase dependency is uncommented
> within $NUTCH_HOME/ivy/ivy.xml
> https://github.com/apache/nutch/blob/2.x/ivy/ivy.xml#L116
>
> You then need to ensure that that the storage.data.store.class is correct
> in $NUTCH_HOME/conf/nutch-default.xml. This needs to be set to
> 'org.apache.gora.hbase.store.HBaseStore'
> https://github.com/apache/nutch/blob/2.x/conf/nutch-default.xml#L1333-L1371
>
> Finally, you need to configure $NUTCH_HOME/conf/gora.properties
> https://github.com/apache/nutch/blob/2.x/conf/gora.properties
> Make sure that the correct gora-hbase configuration is included.
>
> That is all you need to do.
> Lewis
>
> On Fri, Feb 19, 2016 at 10:29 PM, Tom Running 
> wrote:
>
>> Furkan,
>>
>> What you had mention is exactly what I am trying to accomplish.
>> > Using Nutch to crawl websites and storing them at Hbase and indexing at
>> Solr via Gora?
>>
>>
>> I need a bit more help to ensure what I am about to do is correct..
>>
>> #1.
>> after successfully build GORA.  I have the following two .jar files in
>> /gora/gora-solr/lib/  directory.  Lot of .jar files in the /lib directory
>> but only two .jar files relative to solr.
>> solr-solrj-4.10.3.jar
>> solr-core-4.10.3.jar
>>
>>
>> #2.
>> In the solr source distribution directory I have also see the same exact
>> .jar files.  This is a source code download.  I have not build this solr
>> yet.
>>
>> /home/solr/dist
>> solr-solrj-4.10.3.jar
>> solr-core-4.10.3.jar
>> solr-4.10.3.war
>>
>>
>> My question is.   Should I copy the two solr files in #1 to
>> /home/solr/dist/  then build solr?
>>
>>
>> #3.
>> Should I also do the same thing for hbase.  Copy the
>> /gora/gora-hbase/lib/hbase-* into/hbase/lib/  then build hbase?
>>
>>
>>
>> Thank you.
>> Tom
>>
>> On Wed, Feb 17, 2016 at 5:31 PM, Furkan KAMACI 
>> wrote:
>>
>>> Hi Tom,
>>>
>>> What do you aim? Using Nutch to crawl websites and storing them at Hbase
>>> and indexing at Solr via Gora? Do you have any other use cases?
>>>
>>> "Simply", you may think that Gora will act as Hibernate of NoSQL
>>> ecosystem at your use case. So, it will not run as a service, it will be a
>>> dependency.
>>>
>>> Kind Regards,
>>> Furkan KAMACI
>>> 17 Şub 2016 22:13 tarihinde "Lewis John Mcgibbney" <
>>> lewis.mcgibb...@gmail.com> yazdı:
>>>
>>> Hi Tom,
 You can just follow the following tutorial
 http://wiki.apache.org/nutch/Nutch2Tutorial
 Replacing the gora-hbase configuration from within your Nutch
 conf/nutch-default.xml and conf/gora.properties and with the relevant
 dependency from within ivy/ivy.xml with the gora-solr equivalent.
 Any more issues then please let us know. Gora does not run as a service
 no, it is a dependency and is managed through your client dependency
 manager (which in Nutch 2.X is Ivy).
 Thanks

 On Wed, Feb 17, 2016 at 12:04 PM, Tom Running 
 wrote:

> Furkan and Lewis,
>
> Thank you for your response to my SOS.  I tried varies suggestion on
> editing pom.xlm file and including down grade the java JDK version to 1.7
> and removed the .m2 folder and run  mvn clean install   again and it
> build successfully.
>
> Now Gora is successfully build.  I am trying to understand how to get
> Gora run or start in order get the following three packages to work
> together Nutch, Solr and Hbase with GORA
> Does Gora start as a service?
> Or
> To get other three packages to work with GORA I will need to copy the
> *.jar to the three packages (Nutch, Solr and Hbase) lib folder?
>
>
> *I am a bit confuse on how to get these packages to work with GORA.  I
> had read GORA's quickstart guide but am still not too clear on what to 
> do.*
>
>
> *Can you provide some direction.*
>
> *Thank you.*
>
> *Tom*
>
> On Wed, Feb 17, 2016 at 1:56 PM, Furkan KAMACI  > wrote:
>
>> Hi Tom,
>>
>> It seems that your maven is at offline mode. There may be a problem
>> with your settings.xml or environment variable for maven home. How do you
>> build your project? Could you build it with -X option and send the 
>> output?
>>
>> Kind Regards,
>> Furkan KAMACI
>> 17 Şub 2016 20:51 tarihinde "Tom Running" 
>> yazdı:
>>
>> What to do with the error below.
>>
>>
>> [INFO] Building Apache Gora :: Accumulo 0.6.1
>> [INFO]
>> 

Re: GORA build problem.

[Lewis John Mcgibbney]

Hi Tom,
All you need to do is ensure that gora-hbase dependency is uncommented
within $NUTCH_HOME/ivy/ivy.xml
https://github.com/apache/nutch/blob/2.x/ivy/ivy.xml#L116

You then need to ensure that that the storage.data.store.class is correct
in $NUTCH_HOME/conf/nutch-default.xml. This needs to be set to
'org.apache.gora.hbase.store.HBaseStore'
https://github.com/apache/nutch/blob/2.x/conf/nutch-default.xml#L1333-L1371

Finally, you need to configure $NUTCH_HOME/conf/gora.properties
https://github.com/apache/nutch/blob/2.x/conf/gora.properties
Make sure that the correct gora-hbase configuration is included.

That is all you need to do.
Lewis

On Fri, Feb 19, 2016 at 10:29 PM, Tom Running  wrote:

> Furkan,
>
> What you had mention is exactly what I am trying to accomplish.
> > Using Nutch to crawl websites and storing them at Hbase and indexing at
> Solr via Gora?
>
>
> I need a bit more help to ensure what I am about to do is correct..
>
> #1.
> after successfully build GORA.  I have the following two .jar files in
> /gora/gora-solr/lib/  directory.  Lot of .jar files in the /lib directory
> but only two .jar files relative to solr.
> solr-solrj-4.10.3.jar
> solr-core-4.10.3.jar
>
>
> #2.
> In the solr source distribution directory I have also see the same exact
> .jar files.  This is a source code download.  I have not build this solr
> yet.
>
> /home/solr/dist
> solr-solrj-4.10.3.jar
> solr-core-4.10.3.jar
> solr-4.10.3.war
>
>
> My question is.   Should I copy the two solr files in #1 to
> /home/solr/dist/  then build solr?
>
>
> #3.
> Should I also do the same thing for hbase.  Copy the
> /gora/gora-hbase/lib/hbase-* into/hbase/lib/  then build hbase?
>
>
>
> Thank you.
> Tom
>
> On Wed, Feb 17, 2016 at 5:31 PM, Furkan KAMACI 
> wrote:
>
>> Hi Tom,
>>
>> What do you aim? Using Nutch to crawl websites and storing them at Hbase
>> and indexing at Solr via Gora? Do you have any other use cases?
>>
>> "Simply", you may think that Gora will act as Hibernate of NoSQL
>> ecosystem at your use case. So, it will not run as a service, it will be a
>> dependency.
>>
>> Kind Regards,
>> Furkan KAMACI
>> 17 Şub 2016 22:13 tarihinde "Lewis John Mcgibbney" <
>> lewis.mcgibb...@gmail.com> yazdı:
>>
>> Hi Tom,
>>> You can just follow the following tutorial
>>> http://wiki.apache.org/nutch/Nutch2Tutorial
>>> Replacing the gora-hbase configuration from within your Nutch
>>> conf/nutch-default.xml and conf/gora.properties and with the relevant
>>> dependency from within ivy/ivy.xml with the gora-solr equivalent.
>>> Any more issues then please let us know. Gora does not run as a service
>>> no, it is a dependency and is managed through your client dependency
>>> manager (which in Nutch 2.X is Ivy).
>>> Thanks
>>>
>>> On Wed, Feb 17, 2016 at 12:04 PM, Tom Running 
>>> wrote:
>>>
 Furkan and Lewis,

 Thank you for your response to my SOS.  I tried varies suggestion on
 editing pom.xlm file and including down grade the java JDK version to 1.7
 and removed the .m2 folder and run  mvn clean install   again and it
 build successfully.

 Now Gora is successfully build.  I am trying to understand how to get
 Gora run or start in order get the following three packages to work
 together Nutch, Solr and Hbase with GORA
 Does Gora start as a service?
 Or
 To get other three packages to work with GORA I will need to copy the
 *.jar to the three packages (Nutch, Solr and Hbase) lib folder?


 *I am a bit confuse on how to get these packages to work with GORA.  I
 had read GORA's quickstart guide but am still not too clear on what to do.*


 *Can you provide some direction.*

 *Thank you.*

 *Tom*

 On Wed, Feb 17, 2016 at 1:56 PM, Furkan KAMACI 
 wrote:

> Hi Tom,
>
> It seems that your maven is at offline mode. There may be a problem
> with your settings.xml or environment variable for maven home. How do you
> build your project? Could you build it with -X option and send the output?
>
> Kind Regards,
> Furkan KAMACI
> 17 Şub 2016 20:51 tarihinde "Tom Running" 
> yazdı:
>
> What to do with the error below.
>
>
> [INFO] Building Apache Gora :: Accumulo 0.6.1
> [INFO]
> 
> [WARNING] The POM for org.apache.accumulo:accumulo-core:jar:1.5.1 is
> missing, no dependency information available
> [WARNING] The POM for
> org.apache.accumulo:accumulo-minicluster:jar:1.5.1 is missing, no
> dependency information available
> [WARNING] The POM for org.jboss.netty:netty:jar:3.2.2.Final is
> missing, no dependency information available
> [INFO]
> 
> [INFO]