westonpace commented on issue #10929: URL: https://github.com/apache/arrow/issues/10929#issuecomment-898208010
If you don't want to install Arrow from source you can try using the environment variable `ARROW_DEFAULT_MEMORY_POOL` to switch to a different allocator: ``` (arrow-release-5) pace@pace-desktop:~$ ARROW_DEFAULT_MEMORY_POOL=jemalloc python -c "import pyarrow; print(pyarrow.default_memory_pool().backend_name)" jemalloc (arrow-release-5) pace@pace-desktop:~$ ARROW_DEFAULT_MEMORY_POOL=system python -c "import pyarrow; print(pyarrow.default_memory_pool().backend_name)" system (arrow-release-5) pace@pace-desktop:~$ ARROW_DEFAULT_MEMORY_POOL=mimalloc python -c "import pyarrow; print(pyarrow.default_memory_pool().backend_name)" mimalloc ``` I'm not sure off the top of my head what options are available in the pyarrow wheel. Also, some research suggests that there might be certain settings that can be set to get jemalloc working. Can you share your Dockerfile so I can try and reproduce? > I contacted the mailing list on the 27th of July for this. Thanks! Yikes, unfortunately, I don't see any message on that date on either [user@](https://lists.apache.org/[email protected]) or [dev@](https://lists.apache.org/[email protected]) Did you make sure to subscribe to the mailing list before you sent your message? The mailing list will ignore emails from unsubscribed users. If you're pretty confident you subscribed then email me at weston dot pace at gmail dot com (remove spaces and replace `dot` with `.` and `at` with `@`) so I can get your email. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
