[EMAIL PROTECTED] wrote:
Thanks for the tips. But I have a monster computer, 12G RAM and dual 64 bits processors, my network connection is 100 MB/S! I guess Nutch doesn't close the opened sockets in the case of bad host! I am still strugelling with problem.
If the OS is using a default/generic configuration, you should look into tuning the machine for a specific purpose. Linux has an enormous number of settings for max sockets (with a breakdown by various states like SYN or FIN, etc.) and various buffer settings, including a max total buffer space for sockets which might be your problem. The socket maximums can be set at both the system level and per-process. If you can report how many sockets are in the various states when the problem occurs, that would be needed in order to determine whether there is a leak. In any case, there are always opportunities to tune the server and the software. Paul
