Re: [Nutch-general] Really big indexing and timeouts?

2007-07-31 Thread Doğacan Güney
Hi Dennis,

On 7/31/07, Dennis Kubes [EMAIL PROTECTED] wrote:
 Is anybody doing really big indexing jobs on Nutch and Hadoop, say 50M
 or more and seeing indexer timeout jobs?

I think we did a ~30M url indexing and didn't run into any problems.

Did you get a task timeout? (can it be related to a slowish indexing
filter like language-identifier?)


 Dennis



-- 
Doğacan Güney
-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now   http://get.splunk.com/
___
Nutch-general mailing list
Nutch-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-general


[Nutch-general] Really big indexing and timeouts?

2007-07-30 Thread Dennis Kubes
Is anybody doing really big indexing jobs on Nutch and Hadoop, say 50M 
or more and seeing indexer timeout jobs?

Dennis

-
This SF.net email is sponsored by: Splunk Inc.
Still grepping through log files to find problems?  Stop.
Now Search log events and configuration files using AJAX and a browser.
Download your FREE copy of Splunk now   http://get.splunk.com/
___
Nutch-general mailing list
Nutch-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-general