nevi-me opened a new pull request #9137: URL: https://github.com/apache/arrow/pull/9137
Adds Recordbatch body compression, which compresses the buffers that make up arrays (e.g. offsets, null buffer). I've restricted the write side to only work with v5 of the metadata. We can expand on this later, as I think the non-legacy v4 supports the `BodyCompression` method implemented here. Reading should be fine if the compression info is specified. This PR is built on top of ARROW-10299 (#9122). I have not yet implemented ZSTD compression, but I expect it shouldn't be too much work, so can still be done as part of this PR. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
