On 09:59:45 03/Oct , Doug Cutting wrote:
> I suspect threads are hanging, probably in the parser,
I tried to not parse, but without good results.
If I use 100 threads, I can download pages at 500KB/s for about 5 seconds,
but after that, the download rate falls to 0. If I set 20 threads, I can
download
at 200KB for 4/5 minutes, and the rate initially seems very stable. But, after
theese few minutes, the rate starts to get lower and lower, and tends to reach
zero pages/s.
> but sometimes TCP
> connections get stuck too.
If this is the problem, how can I fix it? And How can I recognize it?
Thanks!
-z
--
Free Software Enthusiast
Debian Powered Linux User #332564
http://menoz.homelinux.org
-------------------------------------------------------
This SF.Net email is sponsored by:
Power Architecture Resource Center: Free content, downloads, discussions,
and more. http://solutions.newsforge.com/ibmarch.tmpl
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers
