Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-06 Thread 'Paulo Matos' via Racket Users
On 05/11/2018 15:57, Matt Jadud wrote: > Hi all, > > First, thank you for the conversation around this.  > > On Sun, Nov 4, 2018 at 5:30 PM George Neuner > wrote: > > > One .zo per distributed place is just one descriptor per process.  > Again insignific

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-05 Thread Matt Jadud
On Mon, Nov 5, 2018 at 11:49 AM George Neuner wrote: > > Don't throw it away too quickly. > > With a nod to process/thread scheduling: unless you muck with > process/thread groups, by default Linux tries to gang schedule all the > (ready) threads of a process to run simultaneously. > > Rather tha

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-05 Thread George Neuner
On 11/5/2018 9:57 AM, Matt Jadud wrote: On Sun, Nov 4, 2018 at 5:30 PM George Neuner > wrote: One .zo per distributed place is just one descriptor per process.  Again insignificant because you have 4K per process. It's apparent that the code is leakin

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-05 Thread Matt Jadud
Hi all, First, thank you for the conversation around this. On Sun, Nov 4, 2018 at 5:30 PM George Neuner wrote: > > One .zo per distributed place is just one descriptor per process. Again > insignificant because you have 4K per process. > > It's apparent that the code is leaking descriptors som

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread 'Paulo Matos' via Racket Users
On 04/11/2018 22:56, Matt Jadud wrote: > On Sun, Nov 4, 2018 at 4:30 PM 'Paulo Matos' via Racket Users > mailto:racket-users@googlegroups.com>> > wrote: > > Curious about what your places are doing. > How come you started so many places without seeing this: > https://groups.google.c

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread Matt Jadud
On Sun, Nov 4, 2018 at 5:30 PM George Neuner wrote: > > I'm not sure what you mean by "*my* descriptors". > I know what I mean, and I was incorrect. I was thinking my limit was per-user, not per-process. Why I thought that, I don't know. This thread gives me enough to work with in terms of next

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread George Neuner
On 11/4/2018 4:47 PM, Matt Jadud wrote: On Sun, Nov 4, 2018 at 2:17 PM George Neuner > wrote: Are you using in-process places or distributed places?   In-process places are just OS threads in the same process. Distributed places can be lau

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread Matt Jadud
On Sun, Nov 4, 2018 at 4:58 PM Stefan Schmiedl wrote: > You could also try to _reduce_ one of the limits of the current > session at at time and see if that makes a difference. No need to > bother the sysadmins for that. > Oooh. That saves me the risk of BOFH-style losses of my home di

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread Stefan Schmiedl
Hello Matt, "Matt Jadud" , 04.11.2018, 22:47: > I won't be able to investigate more until tomorrow or Tuesday, > given my schedule. I might start by asking for a bump in the file descriptor > from the sysadmins. You could also try to _reduce_ one of the limits of the current session a

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread Matt Jadud
On Sun, Nov 4, 2018 at 4:30 PM 'Paulo Matos' via Racket Users < racket-users@googlegroups.com> wrote: > Curious about what your places are doing. > How come you started so many places without seeing this: > https://groups.google.com/d/msg/racket-users/oE72JfIKDO4/zbFI6knhAQAJ > > Could you share w

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread Matt Jadud
On Sun, Nov 4, 2018 at 2:17 PM George Neuner wrote: Are you using in-process places or distributed places? In-process places > are just OS threads in the same process. Distributed places can be > launched in/as separate processes, but then each process would have its own > set of file descript

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread 'Paulo Matos' via Racket Users
Hi, Curious about what your places are doing. How come you started so many places without seeing this: https://groups.google.com/d/msg/racket-users/oE72JfIKDO4/zbFI6knhAQAJ Could you share what each of the places do? Paulo Matos On 04/11/2018 18:18, Matt Jadud wrote: > Hi all, > > I have some

Re: [racket-users] Places and many cores? (File descriptor limit?)

2018-11-04 Thread George Neuner
On 11/4/2018 12:18 PM, Matt Jadud wrote: I have some code that is unhappy.  I suspect I'm running into an OS-level resource limit. I'm working with an Intel Phi machine running CentOS that reports 256 cores. It is built using the Intel Xeon Phi 7210, which suggests that it has four, 64-core