[
https://issues.apache.org/jira/browse/SPARK-52482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-52482:
-----------------------------------
Assignee: Sandip Agarwala
> ZStandard support for file data source reader
> ---------------------------------------------
>
> Key: SPARK-52482
> URL: https://issues.apache.org/jira/browse/SPARK-52482
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.1.0
> Reporter: Sandip Agarwala
> Assignee: Sandip Agarwala
> Priority: Major
>
> The current Hadoop version in Spark hasn’t been compiled with Zstd because of
> which ZSTD compressed json, csv, txt and xml files cannot be read. Spark has
> a built-in ZStdCompressionCodec, which is used for compressing shuffled data
> and other use cases.
> This Jira tracks task to add support for ZSTD in file data source readers
> using the built-in ZStdCompressionCodec.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
