[issue37185] use os.memfd_create in multiprocessing.shared_memory?

2019-09-09 Thread Christian Heimes
Christian Heimes added the comment: You are corret, Davin. The concept of memory fd is a new Linux Kernel feature. It's not available on older Linux Kernels or on non-Linux OS. To share memory fd segments between processes, the processes have to exchange or inherit the file descriptor

[issue37185] use os.memfd_create in multiprocessing.shared_memory?

2019-09-09 Thread Davin Potts
Davin Potts added the comment: Unless I am missing something, memfd_create appears to be specific to the Linux kernel still so we would need to replicate its behavior on all of the other unix systems. To your point, but quoting from the docs, "separate invocations of memfd_create with the

[issue37185] use os.memfd_create in multiprocessing.shared_memory?

2019-08-04 Thread Vinay Sharma
Vinay Sharma added the comment: Hi @pierreglaser, I recently started using the shared_memory module in multiprocessing , and as you said using memfd_create wouldn't require resource tracking is true. But, I was wondering if these memory segments can't be related/mapped using a unique name,

[issue37185] use os.memfd_create in multiprocessing.shared_memory?

2019-06-06 Thread Pierre Glaser
New submission from Pierre Glaser : Hi, Following https://bugs.python.org/issue26836, I started thinking about using memfd_create instead of shm_open for creating shared-memory segments in multiprocessing.shared_memory. The main advantage of memfd_create over shm_open is that the generated