shanjixi commented on issue #36608: URL: https://github.com/apache/arrow/issues/36608#issuecomment-1633795635
> Seems it's just `SnappyCodec`? Can you just try the: > > 1. https://github.com/apache/arrow/blob/main/cpp/src/arrow/util/compression.h > 2. or https://arrow.apache.org/docs/python/generated/pyarrow.compress.html This is not block based compress/unpresss support. If we read a hadoop-snappy files, we need to uncompress blocks one by one, which is not convinenet enought for high level components; If we read blocks from one Haddoop-Snappy file, definitely we do need to uncompress one block with the help of "arrow/util/compression.h"; However we still need to wright extra code to provide a StreamingView for a serial of uncompressed snappy blocks for hight level component. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
