[
https://issues.apache.org/jira/browse/ARROW-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17605105#comment-17605105
]
Adam Reeve commented on ARROW-16921:
------------------------------------
Hi [~rishabhrana], I wanted to get some proof-of-concept code working using
decompression so I've implemented basic Zstd decompression support in my Arrow
fork:
[https://github.com/apache/arrow/compare/master...adamreeve:arrow:dotnet_decompression]
It isn't in a state suitable for a pull request and just adds ZstdNet as a
dependency of Apache.Arrow, which required bumping the target framework to
netstandard2.0, but it might still be useful to you as a starting point,
depending on how far you've already got with this.
> [C#] Add decompression support for Record Batches
> -------------------------------------------------
>
> Key: ARROW-16921
> URL: https://issues.apache.org/jira/browse/ARROW-16921
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C#
> Reporter: Rishabh Rana
> Assignee: Rishabh Rana
> Priority: Major
>
> C# Implementation does not support reading batches written in other
> implementations of Arrow when the compression is specified in IPC Write
> options.
> e.g. Reading this batch from pyarrow in C# will fail:
> pyarrow.ipc.RecordStreamBatchWriter(sink, schema,
> options=pyarrow,ipcWriteOptions(compression="lz4"))
>
> This is to support decompression (lz4 & zstd) in the C# implementation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
