Well, it's just going to add more work for me, but in the end, it's probably
something that needs to be in there. I could go either way on this though,
as in, if we don't commit it, 0.9.1 shouldn't be far off. Here's my +1 for
going ahead and committing it...


On 3/28/07 10:21 AM, "Dennis Kubes" <[EMAIL PROTECTED]> wrote:

> Yes.  This seems to have fixed the problem.  All, do we want to create a
> JIRA and commit this for the 0.9 release?
> 
> Dennis
> 
> Andrzej Bialecki wrote:
>> Doğacan Güney wrote:
>>> Hi,
>>> 
>>> On 3/28/07, Dennis Kubes <[EMAIL PROTECTED]> wrote:
>>>> 
>>>> This is definitely a hadoop problem.  This is similar to the classpath
>>>> issues that we were encountering before with Hadoop and the
>>>> ReductTaskRunner.  When I include the nutch-*.jar in the hadoop class
>>>> path the errors go away.  Not a fix but it proves the point that this is
>>>> an issue with Hadoop class loading.
>>>> 
>>>> Dennis Kubes
>>>> 
>>>> 
>>> Dennis, you were running SegmentMerger, I presume? This occurs probably
>>> because in SegmentMerger and SegmentReader's dump Nutch uses JobConf
>>> instead
>>> of NutchJob. Because of this Hadoop can't find the necessary job file.
>>> 
>>> I put a simple patch at
>>> http://www.ceng.metu.edu.tr/~e1345172/use-nutch-job.patch . Can you
>>> try it
>>> with this?
>>> 
>> 
>> Duh, the patch seems to be exactly what's needed - thanks Doğacan!
>> 
>> In the future we should rework the test suite to execute using a "clean"
>> Hadoop installation, i.e. one where Hadoop daemons are started without
>> Nutch classes on the classpath.
>> 
>> 



-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to