Agree. I've already implemented something like this, and also fire up new threads if the number of timed-out threads exceed a % of the total number. Unfortunately on some crawls, I ran into SocketExceptions (Too many files open)..
On Tue, 29 Mar 2005 15:24:54 -0500, andy wrote: >�Nevertheless, perhaps we should implement a timeout for >�fetcher/parser threads to protect against renegade plugins? �Maybe >�if a fetcher thread hasn't checked in after X seconds, the thread >�is interrupted. ------------------------------------------------------- SF email is sponsored by - The IT Product Guide Read honest & candid reviews on hundreds of IT Products from real users. Discover which products truly live up to the hype. Start reading now. http://ads.osdn.com/?ad_ide95&alloc_id396&op=click _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
