alamb opened a new issue, #8676: URL: https://github.com/apache/arrow-rs/issues/8676
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** - Follow on to https://github.com/apache/arrow-rs/pull/7997 The ParquetMetaDataPushDecoder and `ParquetPushDecoder` both use a structured named `PushBuffers` to store in memory buffer state. The `ParquetPushDecoder` will free any ranges it explicitly asked for after it has completed reading a row group. However, if a user eagerly pushes ranges / parts of a file, the `ParquetPushDecoder` will use those for decoding, but won't explicitly free them. There is also no way to free them manually either **Describe the solution you'd like** As we mentioned in https://github.com/apache/arrow-rs/pull/7997#discussion_r2436922544, it would be nice to have some way to release all underlying memory in the `ParquetPushDecoder` **Describe alternatives you've considered** Perhaps we can add an API like ```rust let mut push_decoder = ...; // release references to any data that has previously been pushed via push_ranges push_decoder.release_all_ranges() **Additional context** <!-- Add any other context or screenshots about the feature request here. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
