pitrou commented on issue #45287: URL: https://github.com/apache/arrow/issues/45287#issuecomment-2622010173
> Calling `arrow::default_memory_pool()->ReleaseUnused()`after every record batch is read also seems to not have an effect > > My shaky understanding of Arrow memory pools and allocators says this means the memory usage I'm hoping to reduce is some memory that is not allocated on the Arrow memory pool? `ReleaseUnused` is best effort, so you can't really deduce this unfortunately. The new [`PrintStats` method](https://github.com/apache/arrow/pull/45359) might allow you to get a better idea, though the allocator stats are not always easy to understand. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
