jon-chuang edited a comment on pull request #270: URL: https://github.com/apache/arrow/pull/270#issuecomment-1030628903
Jemalloc with Reallocate shows an improvement on a single thread. What happens when there are multiple concurrent allocations? (my understanding is that jemalloc tends to maintain separate heaps i.e. glibc's arenas, partly to facilitate concurrrency. So concurrent allocations would not interfere? Especially with large-ish allocations and sufficient total memory pool size) Are there hints one can drop to jemalloc that one intends to grow the block to increase the chance of growing the allocation in-place? i.e. have the allocator choose to place concurrent allocations in separate heaps? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
