Hi there, I'm also trying to bump Nutch 2.x to Hadoop 2. So far I have: - patched Gora 0.5 to support Hadoop 2 - changed the Hadoop dependencies (to hadoop-common and hadoop-clent, ver 2.4.0) so I had to fix a couple compiler errors - bumped the Accumulo client in Gora (I'm working on CDH5.1 which ships with 1.6) and also there had to tweak some code
Gora build fails with tests (but I understand this it "normal" given the state of the branch) but ok, so I went ahead and did the same for Nutch. Right now I'm having problems running the deployable job (the uberjar:) it connects to Accumulo and creates the table, but later on it fails as it seems to not find the Gora output format class, don't know really what's going on... the gora-code jar is packaged in the jar under /lib. One final note: I moved to code into a maven project... I'm not that familiar with Ivy Best, Edoardo Sent from my iPhone > On 9 sep. 2014, at 17:45, Lewis John Mcgibbney <[email protected]> > wrote: > > Hi Sachin, > >> On Tue, Sep 9, 2014 at 8:38 AM, <[email protected]> wrote: >> >> >> hi all i am trying to make nutch2.3 compatible with hadoop 2 so now i am >> facing some problems. >> >> I have configured apache gora0.4 and hbase 0.94 with nutch2.3 >> >> so now when i inject the urls in the database a table is created but when >> i do the generate step my job is failing when i run my job in local mode > We're about to release Apache Gora 0.5 which will provide shim layers [0] > for backwards compatable support of multiple Hadoop versions. > > It would really help ifg you could post what kind of errors you are getting > in local mode, we can then log them, track them and try to resolvce them > when Nutch 2.3-SNAPSHOT upgrades to Gora 0.5 prior to release of Nutch 2.3. > Thanks > Lewis > > [0] https://issues.apache.org/jira/browse/GORA-346
