lwpyr opened a new issue, #4410: URL: https://github.com/apache/arrow-rs/issues/4410
**Describe the bug** The wrongly calculated compressed length included the full original buffer length, which will decline almost all the compressable data. Suppose original buffer len is *a*, incoming data len is *b*, compressed data len is *c*, the code should compare *b* and *c* instead of *b* and *a+c* **To Reproduce** 1. Use Python to write a IPC file compressed with ZSTD, the size is 1.7 MB 2. Use arrow-rs to read data from python encoded IPC file, then write again to the disk with ZSTD encoded, but the file size is 20 MB. 3. Apply the change of the PR, the file size produced by arrow-rs is 1.6 MB **Expected behavior** arrow-rs IPC writer should compress those data worth compression. **Additional context** N/A -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
