I have tried to fetch a 625,000 segment twice now and it always hangs right
after the last site above.
My guess is that there's a fetcher thread that's been hung for a long time, probably parsing a pdf. If that's the case, I think it has been fixed.
Is there a way to gracefully end a fetch of a segment after it hangs? Should I just normally update the database after getting to a place that it hangs or do I need to "touch" any directories so I don't mess up the database?
You can update the database with the output of an aborted fetch. It may print an "unexpected end of file" warning, but all of the collected data will be updated.
Doug
------------------------------------------------------- This SF.Net email is sponsored by BEA Weblogic Workshop FREE Java Enterprise J2EE developer tools! Get your free copy of BEA WebLogic Workshop 8.1 today. http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click _______________________________________________ Nutch-general mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-general
