Windows 2000 Standard Server 4GB Ram J2SE v1.4.2_08 (java_opts: -ms 512mb ram, xmx 1024mb ram) Nutch v0.6 (All components standard incl. fetcher)
The fetcher does its usual thing the interesting thing is that it usually locks up at only the end (or near the end) of a segment which is fetched - be it 100, 1000 or 10000 urls. If i set the fetcher threads to 5 then it works but obviously is slow - if i set it to 100 it flies but locks up randomly near the end of fetching a segments. The last 3 lines before fetcher dies: 050623 114407 fetch of http://www.veza.co.za/ failed with: net.nutch.protocol.http.HttpException: java.net.SocketTimeoutException: Read timed out 050623 114410 fetch of http://www.visserinc.co.za/ failed with: net.nutch.protocol.http.HttpException: java.net.SocketTimeoutException: Read timed out 050623 114414 fetch of http://www.webdesigner.co.za/ failed with: net.nutch.protocol.http.HttpException: java.net.SocketTimeoutException: Read timed out (LOCKED UP - pressed control-c and got cygwin prompt) [EMAIL PROTECTED] /nutch-0.6 $ Any other information u need? Thanks in advance On Thu, 23 Jun 2005 11:16:12 +0200 Andrzej Bialecki <[EMAIL PROTECTED]> wrote: > [EMAIL PROTECTED] wrote: > > Most of the time the following error occurs near the > end > > just before the fetcher freezes/locks up: > > java.net.SocketTimeoutException: Read timed out > > > > Any1 have any ideas? > > Please do a full thread dump (Ctrl-E on Unix, Ctrl-Break > on Windows), and also provide us with more details about > your environment (nutch version / revision, which HTTP > plugin, OS and JDK version). If there are stacktraces at > the end, please send them too. > > > -- > Best regards, > Andrzej Bialecki <>< > ___. ___ ___ ___ _ _ > __________________________________ > [__ || __|__/|__||\/| Information Retrieval, Semantic > Web > ___|||__|| \| || | Embedded Unix, System Integration > http://www.sigram.com Contact: info at sigram dot com > _____________________________________________________________________ For super low premiums, click here http://www.dialdirect.co.za/quote ------------------------------------------------------- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_id=7477&alloc_id=16492&op=click _______________________________________________ Nutch-general mailing list Nutch-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nutch-general
