[
https://issues.apache.org/jira/browse/ARROW-3831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691138#comment-16691138
]
Kouhei Sutou commented on ARROW-3831:
-------------------------------------
I think that the actual decompressed size even when we know the expected
decompressed size.
For example, we can validate the decompression result. If the actual
decompressed size and the expected one is different, the compressed data will
be broken (or decompress logic is broken).
As far as I know, zlib, LZ4 and Zstandard return the actual decompressed size.
> [C++] arrow::util::Codec::Decompress() doesn't return decompressed data size
> ----------------------------------------------------------------------------
>
> Key: ARROW-3831
> URL: https://issues.apache.org/jira/browse/ARROW-3831
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Affects Versions: 0.11.1
> Reporter: Kouhei Sutou
> Priority: Major
>
> We can't know decompressed data size when we only have compressed data. The
> current {{arrow::util::Codec::Decompress()}} doesn't return decompressed data
> size. So we can't know which data in {{output_buffer}} can be used.
> FYI: {{arrow::util::Codec::Compress()}} returns compressed data size.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
