pitrou commented on code in PR #41117:
URL: https://github.com/apache/arrow/pull/41117#discussion_r1559297477
##########
cpp/src/arrow/io/compressed.cc:
##########
@@ -353,7 +355,10 @@ class CompressedInputStream::Impl {
// Try to feed more data into the decompressed_ buffer.
Status RefillDecompressed(bool* has_data) {
- // First try to read data from the decompressor
+ // First try to read data from the decompressor.
+ // This doesn't use `CompressedBufferAvailable()` because when compressed_
+ // exists and available == 0, it might trigger an empty decompress and set
Review Comment:
If the compressed data length is 64 kB, but the decompressed data length is
1 MB, then you'll get several chunks of decompressed data after the compressed
data has ended.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
