Nutch 2.0 is pre-configed with gora 0.2, and I checked gora website,
0.2.1 is the latest release.
I edited ivy/ivy.xml to update gora-core/ gora-hbase version from 0.2
to 0.2.1 and then re-compile. It still fetched hbase-0.90.4.jar
To Alex,
Yes, i did removed the old hbase jar from runtime/local/lib. When i
re-run it, got the following exception:
InjectorJob: starting
InjectorJob: urlDir: seed
Exception in thread "main" java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.HColumnDescriptor.setMaxVersions(I)V
at
org.apache.gora.hbase.store.HBaseMapping$HBaseMappingBuilder.addFamilyProps(HBaseMapping.java:114)
at
org.apache.gora.hbase.store.HBaseStore.readMapping(HBaseStore.java:543)
at
org.apache.gora.hbase.store.HBaseStore.initialize(HBaseStore.java:111)
at
org.apache.gora.store.DataStoreFactory.initializeDataStore(DataStoreFactory.java:102)
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:161)
at
org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135)
at
org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:69)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:243)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:268)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:288)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:298)
On Mon, Aug 13, 2012 at 10:16 AM, Lewis John Mcgibbney
<[email protected]> wrote:
> Nutch contains no knowledge of which specific version of a backend you
> are using. This is however done through the gora-* dependencies
> managed by Ivy.
>
> Although this is a pretty convoluted way to do things, the best way to
> find this would be to check out Gora trunk [0], upgrade the hbase
> dependencies to whatever you need, compile and package the project
> then copy the relevant jar's over to your Nutch installation. This way
> you could run a standalone (development) hbase server and try running
> your Nutch configuration that way...
>
> hth
>
> Lewis
>
> [0] http://svn.apache.org/repos/asf/gora/trunk/
>
> On Mon, Aug 13, 2012 at 6:11 PM, Ryan L. Sun <[email protected]> wrote:
>> hi all,
>>
>> I'm trying to set up nutch 2.0 with a existing hbase cluster (using
>> hbase 0.94.0). Since nutch 2.0 supports an older version (0.90.4) of
>> hbase, starting a nutch inject job crashed hbase daemon. Copying hbase
>> 0.94.0's lib to nutch/runtime/local/lib folder as google search hinted
>> doesn't work for me.
>> Any suggestions are appreciated. Thanks.
>>
>> PS. I couldn't downgrade the existing hbase cluster software version,
>> which is out of my hand.
>
>
>
> --
> Lewis
