Re: Nutch upgrade to Hadoop

2009-11-21 Thread Dennis Kubes
I have created NUTCH-768. I am in the middle of testing a few thousand page crawl for the most recent released version of Hadoop 0.20.1. Everything passes unit tests fine and there are no interface breaks. Looks like it will be an easy upgrade so far :) Dennis Andrzej Bialecki wrote:

Re: Nutch upgrade to Hadoop

2009-11-21 Thread Andrzej Bialecki
Dennis Kubes wrote: I have created NUTCH-768. I am in the middle of testing a few thousand page crawl for the most recent released version of Hadoop 0.20.1. Everything passes unit tests fine and there are no interface breaks. Looks like it will be an easy upgrade so far :) Great, thanks!

Re: Nutch upgrade to Hadoop

2009-11-21 Thread Dennis Kubes
Hadoop seems to have a few more configuration files now. There are some questions about which ones to move over. I think it also might be time to upgrade xerces from 2.6 to the current 2.9.1. I am testing with that currently. I know with the current version there are some (ignorable but

Re: Nutch upgrade to Hadoop

2009-11-20 Thread Andrzej Bialecki
John Martyniak wrote: Does anybody know of any concrete plans to update Nutch to Hadoop 0.20, 0.21? Something like a Nutch 1.1 release, get in some bug fixes and get current on Hadoop? I think that should be one of the goals. My 2 cents. I'm planning to do this upgrade soon (~a week) -

Re: Nutch upgrade to Hadoop

2009-11-20 Thread John Martyniak
That is good news.Thank you. I have been debating whether to update my cluster to 0.21...and now I can. -John On Nov 20, 2009, at 2:45 AM, Andrzej Bialecki a...@getopt.org wrote: John Martyniak wrote: Does anybody know of any concrete plans to update Nutch to Hadoop 0.20, 0.21?

Re: Nutch upgrade to Hadoop

2009-11-20 Thread Dennis Kubes
I would like to get a couple things in this release as well. Let me know if you want help with the upgrade. Dennis Andrzej Bialecki wrote: John Martyniak wrote: Does anybody know of any concrete plans to update Nutch to Hadoop 0.20, 0.21? Something like a Nutch 1.1 release, get in some

Re: Nutch upgrade to Hadoop

2009-11-20 Thread Andrzej Bialecki
Dennis Kubes wrote: I would like to get a couple things in this release as well. Let me know if you want help with the upgrade. You mean you want to do the Hadoop upgrade? I won't stand in your way :) -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _