Hi Louis,

Arrow FlightRPC supports UCX transport, which supports IPC over shared memory. Please note UCX support is still experimental, with few documents now.

Yibo

On 7/19/22 16:51, Louis C wrote:

Hello,

For IPC purposes, I was interested in "shared memory" to pass data between processes. The idea would be to create a named shared memory zone (not backed by any file), and write Arrow data in it, then read back this data in another process. On linux this would probably correspond to something like calling "shm_open" and then mmap this region, before writing Arrow data in it. Looking at the docs and the code of Arrow, I think that it is not possible using only Arrow. The only class that comes close to what I would like is "MemoryMappedFile" which is an input/output class to a real file on disk (but mapped in memory at the openning). Is this correct ? Is there any plan in the future to directly support this feature ?

Best regards,
Louis C.

Reply via email to