Re: Workers for multicore processing (Question and RFC)

2017-02-28 Thread Alexander Burger
Hi Petr, > I believe modern Linux systems have much higher than 1024 file descriptor > per process limits. Right. However Joh-Tob was talking about the number of child processes. There is a limit in PicoLisp in how many child processes can be spawned with (fork), caused by the size of an

Re: Workers for multicore processing (Question and RFC)

2017-02-28 Thread Robert Wörle
Am 28.02.2017 um 12:04 schrieb Petr Gladkikh: I believe modern Linux systems have much higher than 1024 file descriptor per process limits. E.g. on my system $ uname -srv Linux 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 $ cat /proc/sys/fs/file-max 2013532 And you can adjust

Re: Workers for multicore processing (Question and RFC)

2017-02-28 Thread Petr Gladkikh
I believe modern Linux systems have much higher than 1024 file descriptor per process limits. E.g. on my system $ uname -srv Linux 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 11:50:30 UTC 2017 $ cat /proc/sys/fs/file-max 2013532 And you can adjust this limit to your requirements. 2017-02-25 12:26

Re: Workers for multicore processing (Question and RFC)

2017-02-25 Thread Mike Pechkin
> > > > > Is there some "worker" implementation which keeps a queue of task to do > and creates N worker processes which take tasks from the queue when they > are finished? > > ​you have to implement everything by yourself. as start point:

Workers for multicore processing (Question and RFC)

2017-02-25 Thread Joh-Tob Schäg
There are limits on how many processes can exist at the same time and having more 'later processes than cores is wasteful and Linux only allows for 1024 file descriptors per process. ? (for N 1 (later (cons) (* N N))) !? (pipe (pr (prog (* N N Pipe error: Too many open files ? N -> 339 Is