socket: too many open file descriptors (Re: Python with many threads)

2008-12-17 Thread Ott Köstner
Hello, Answering my own mail ;) Ott Köstner wrote: Still, something locks up in the system, when I increase the number Python threads with http://grub.org/?q=en/node/204 [...] The frequency of these messages increases with 70 threads. And with 200 threads the system locks up totally --

Re: socket: too many open file descriptors (Re: Python with many threads)

2008-12-17 Thread Ott Köstner
On Wednesday 17 December 2008 4:17:46 pm Michel Talon wrote: Ott Köstner wrote: In /var/log/messages: named[63198]: socket: too many open file descriptors See the sysctl variables: kern.maxfiles kern.maxfilesperproc kern.maxfiles: 12328 kern.maxfilesperproc: 11095 Note that

Re: socket: too many open file descriptors (Re: Python with many threads)

2008-12-17 Thread Michel Talon
Ott Köstner wrote: In /var/log/messages: named[63198]: socket: too many open file descriptors See the sysctl variables: kern.maxfiles kern.maxfilesperproc Note that Google leads immediately to this: http://unix.derkeiler.com/Mailing-Lists/FreeBSD/net/2008-07/msg00251.html -- Michel

Re: Python with many threads

2008-12-16 Thread Ott Köstner
Michel Talon wrote: Nothing limits the number of concurrent threads. Personnally i have checked i can run Grub Next Generation Python Client with 600 threads without any problem. niobe% uname -a FreeBSD niobe.lpthe.jussieu.fr 7.0-STABLE FreeBSD 7.0-STABLE #0: Tue Jul 22 10:31:01 CEST 2008

Re: Python with many threads

2008-12-16 Thread Michel Talon
Otto wrote: Exception in thread 30: Traceback (most recent call last): File /usr/local/lib/python2.5/threading.py, line 486, in __bootstrap_in= ner self.run() The number of errors increases rapidly with even bigger number of threads. Is there any way I can increase the maximum

Python with many threads

2008-12-16 Thread Ott Köstner
Hello list, Trying to run Grub Next Generation Python Client (http://grub.org/?q=en/node/204) on my FreeDSD 7.1 box with as many threads as possible. Python version is 2.5.2. The question is, what limits the number of concurrent threads I can run? I have free memory and cpu, but starting from