socket: too many open file descriptors (Re: Python with many threads)
Hello, Answering my own mail ;) Ott Köstner wrote: Still, something locks up in the system, when I increase the number Python threads with http://grub.org/?q=en/node/204 [...] The frequency of these messages increases with 70 threads. And with 200 threads the system locks up totally -- almost no access from web. [I can still access the system and kill the process :) ] Clearly, there is some limit in the system. It is not memory, cpu or bandwidth. If the number of threads is also not limited, it must be something else. What might it be? Eventually, I found out that the limiting factor here is named, not capable of handling more request and causing Apache to lock up. But now I am trapped here. Is there anybody who can help? In /var/log/messages: named[63198]: socket: too many open file descriptors I have googled this, but no help. Recompiled bind, adding -DFD_SETSIZE=2048 to CFLAGS. No help. sockstat |grep -c named does not big numbers. With 60 Grubng/Pyhton threads this number is around 20, rises over 100 with 100 threads, but this is still much lower than 2048... Any ideas? Regards, O.K. -- Testi oma Interneti kiirust / Test Your Internet speed: http://speedtest.zzz.ee/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: socket: too many open file descriptors (Re: Python with many threads)
On Wednesday 17 December 2008 4:17:46 pm Michel Talon wrote: Ott Köstner wrote: In /var/log/messages: named[63198]: socket: too many open file descriptors See the sysctl variables: kern.maxfiles kern.maxfilesperproc kern.maxfiles: 12328 kern.maxfilesperproc: 11095 Note that Google leads immediately to this: http://unix.derkeiler.com/Mailing-Lists/FreeBSD/net/2008-07/msg00251.html Yes, actually I saw this. 11095 seemed a big number in this case. Increased to: kern.maxfiles: 25000 kern.maxfilesperproc: 2 ... and the problem remains... :( There are also messages like this: named[63198]: client 127.0.0.1#60448: error sending response: host unreachable Regards, O.K. -- Mõõda oma inteneti kiirust / Test Your Internet speed http://speedtest.zzz.ee/ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
Re: socket: too many open file descriptors (Re: Python with many threads)
Ott Köstner wrote: In /var/log/messages: named[63198]: socket: too many open file descriptors See the sysctl variables: kern.maxfiles kern.maxfilesperproc Note that Google leads immediately to this: http://unix.derkeiler.com/Mailing-Lists/FreeBSD/net/2008-07/msg00251.html -- Michel TALON ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to freebsd-questions-unsubscr...@freebsd.org
