emkornfield commented on pull request #7030: URL: https://github.com/apache/arrow/pull/7030#issuecomment-679355309
> Also I suppose if we want to consider block level memory reservation then we should dive into jemalloc and use some thing like a hook API right? That will appear to take me sometime as I am new to jemalloc :) I think this might be overcomplicating things. I think a new MemoryPool implementation that takes a std::function of "reserve" that confirms that memory can be allocated before hand. For JVM purposes, the reserve method would have a preconfigured block size that it requests from Bits.java and it can then request bytes when it consumes its initial reservation. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org