Re: Upgrading to Hadoop 0.22.0+

2011-12-14 Thread Markus Jelsma
Andrzej, I cannot continue with testing migration on 0.20 because things like MapFileOutputFormat are missing in the new API. I cannot compile with 0.22 because it no longer has the old mapred API. And i cannot build with 0.21 because it is not in maven central!? Any help? Thanks! On

Re: Upgrading to Hadoop 0.22.0+

2011-12-14 Thread Markus Jelsma
0.21 is here, can we use this repo for Hadoop 0.21 poms? If so, how to change ivy stuff to do so? I can't seem to tell Ivy to fetch hadoop from here: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop- common/ On Wednesday 14 December 2011 16:05:07 Markus Jelsma

Re: Upgrading to Hadoop 0.22.0+

2011-12-14 Thread Markus Jelsma
Hi, I added Jackson as a dependency and can now build Nutch with Hadoop 0.20.205.0. Hadoop needs it. Should we commit this? I'd prefer migrating to that version before doing all API migrations. Nutch runs fine with 205 locally and also on a 0.20.203 cluster. Thanks On Tuesday 13 December

Re: Upgrading to Hadoop 0.22.0+

2011-12-13 Thread Lewis John Mcgibbney
Hi Markus, I'm certainly in agreement here. If you like to open a Jira, we can begin the build up a picture of what is required. Lewis On Tue, Dec 13, 2011 at 4:41 PM, Markus Jelsma markus.jel...@openindex.io wrote: Hi, To keep up with the rest of the world i believe we should move from the

Re: Upgrading to Hadoop 0.22.0+

2011-12-13 Thread Andrzej Bialecki
On 13/12/2011 17:42, Lewis John Mcgibbney wrote: Hi Markus, I'm certainly in agreement here. If you like to open a Jira, we can begin the build up a picture of what is required. Lewis On Tue, Dec 13, 2011 at 4:41 PM, Markus Jelsma markus.jel...@openindex.io wrote: Hi, To keep up with the

Re: Upgrading to Hadoop 0.22.0+

2011-12-13 Thread Andrzej Bialecki
On 13/12/2011 18:04, Markus Jelsma wrote: Hi I did a quick test to see what happens and it won't compile. It cannot find our old mapred API's in 0.22. I've also tried 0.20.205.0 which compiles but won't run and many tests fail with stuff like. Exception in thread main

Re: Upgrading to Hadoop 0.22.0+

2011-12-13 Thread Markus Jelsma
On 13/12/2011 18:04, Markus Jelsma wrote: Hi I did a quick test to see what happens and it won't compile. It cannot find our old mapred API's in 0.22. I've also tried 0.20.205.0 which compiles but won't run and many tests fail with stuff like. Exception in thread main