Doğacan Güney wrote:
> Hi,
> 
> On 3/28/07, Dennis Kubes <[EMAIL PROTECTED]> wrote:
>>
>> This is definitely a hadoop problem.  This is similar to the classpath
>> issues that we were encountering before with Hadoop and the
>> ReductTaskRunner.  When I include the nutch-*.jar in the hadoop class
>> path the errors go away.  Not a fix but it proves the point that this is
>> an issue with Hadoop class loading.
>>
>> Dennis Kubes
>>
>>
> Dennis, you were running SegmentMerger, I presume? This occurs probably
> because in SegmentMerger and SegmentReader's dump Nutch uses JobConf 
> instead
> of NutchJob. Because of this Hadoop can't find the necessary job file.
> 
> I put a simple patch at
> http://www.ceng.metu.edu.tr/~e1345172/use-nutch-job.patch . Can you try it
> with this?
> 

Duh, the patch seems to be exactly what's needed - thanks Doğacan!

In the future we should rework the test suite to execute using a "clean" 
Hadoop installation, i.e. one where Hadoop daemons are started without 
Nutch classes on the classpath.


-- 
Best regards,
Andrzej Bialecki     <><
  ___. ___ ___ ___ _ _   __________________________________
[__ || __|__/|__||\/|  Information Retrieval, Semantic Web
___|||__||  \|  ||  |  Embedded Unix, System Integration
http://www.sigram.com  Contact: info at sigram dot com


-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to