Helle Jon,
I have the same problem here, the fetcher get stuck aftyher running a few
hours.
How do you get a good crawler if you everytime must repair the database
and start again?
Jon Shoberg wrote:
Is there a way to set the lifetime of a fetching thread? As in if it
can not complete the entire fetching process in X minutes to gracefully
give up?
Anyone else experience the fetcher hanging for a long period of time
(hour+)? I'm using 100 threads, 30 per host. I'm guessing that I have
one host which it is "stuck" on.
-------------------------------------------------------
SF.Net email is sponsored by:
Tame your development challenges with Apache's Geronimo App Server.
Download it for free - -and be entered to win a 42" plasma tv or your very
own Sony(tm)PSP. Click here to play: http://sourceforge.net/geronimo.php
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
