alamb opened a new pull request, #8080: URL: https://github.com/apache/arrow-rs/pull/8080
# Which issue does this PR close? - Part of https://github.com/apache/arrow-rs/issues/8000 # Rationale for this change Metadata is needed when implementing a push decoder for Parquet: - https://github.com/apache/arrow-rs/issues/7983 If we want to truly separate IO and CPU we also need a way to decode the metadata without explicit IO, and hence this PR that provides a way to decode metadata "push style" where it tells you what bytes are needed. It follows the same API as the parquet push decoder This PR also introduces some of the common infrastructure needed in the parquet push decoder # What changes are included in this PR? 1. Add `PushBuffers` to hold byte ranges 2. Add `DecodeResult` to communicate back to the caller 3. Add `ParquetMetaDataPushDecoder` for decoding metadata # Are these changes tested? Yes, there are several fully working doc tests that show how to use this API # Are there any user-facing changes? There is a new API -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
