[
https://issues.apache.org/jira/browse/ARROW-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584514#comment-17584514
]
Weston Pace commented on ARROW-16921:
-------------------------------------
Also, it might be nice if there were a standard compression provider which
auto-detected the presence of common compression packages and added support
automatically if the package was installed. That way the user wouldn't have to
do anything except make sure they had the appropriate compression package
installed.
For example, you could use Type.GetType to check if
System.IO.Compression.GZipStream exists and, if it does, add a GZipDecoder
automatically. However, this would require reflection to create the
GZipStream. Maybe someone can think of a more clever solution.
> [C#] Add decompression support for Record Batches
> -------------------------------------------------
>
> Key: ARROW-16921
> URL: https://issues.apache.org/jira/browse/ARROW-16921
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C#
> Reporter: Rishabh Rana
> Assignee: Rishabh Rana
> Priority: Major
>
> C# Implementation does not support reading batches written in other
> implementations of Arrow when the compression is specified in IPC Write
> options.
> e.g. Reading this batch from pyarrow in C# will fail:
> pyarrow.ipc.RecordStreamBatchWriter(sink, schema,
> options=pyarrow,ipcWriteOptions(compression="lz4"))
>
> This is to support decompression (lz4 & zstd) in the C# implementation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
