alamb opened a new issue, #8137: URL: https://github.com/apache/arrow-rs/issues/8137
The `arrow` crate's use of shared [`Buffer`](https://docs.rs/arrow/latest/arrow/buffer/struct.Buffer.html) allows for fast and memory efficient implementation for operations such as "slice" because slicing is simply a view to the same `Buffer` However it creates problems for memory management when there is more than one `Array` pointing at the same underlying buffer as it is not always clear how much memory should be "charged" to any particular Array and it is hard to avoid double counting buffers when they are shared - This is discussed in https://github.com/apache/arrow-rs/issues/6439 @waynexia is adding a new `MemoryPool` API and this ticket tracks the progress, for visibility and hopefully so others can contribute a bit more to the project ## Tasks / PRs - [ ] https://github.com/apache/arrow-rs/pull/7303 - [ ] https://github.com/apache/arrow-rs/issues/7151 - [ ] https://github.com/apache/arrow-rs/pull/8040 ## Related issues - https://github.com/apache/arrow-rs/issues/6439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
