[
https://issues.apache.org/jira/browse/SPARK-45711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jiaan Geng updated SPARK-45711:
-------------------------------
Description:
Currently, Spark supported all the avro compression codecs, but the avro
supported compression codecs and spark supported are not completely one-on-one
due to Spark introduce the compression codecs UNCOMPRESSED.
There are a lot of magic strings copy from orc compression codecs. This issue
lead to developers need to manually maintain its consistency. It is easy to
make mistakes and reduce development efficiency.
was:
Currently, Spark supported all the orc compression codecs, but the orc
supported compression codecs and spark supported are not completely one-on-one
due to Spark introduce two compression codecs none and UNCOMPRESSED.
There are a lot of magic strings copy from orc compression codecs. This issue
lead to developers need to manually maintain its consistency. It is easy to
make mistakes and reduce development efficiency.
> Introduce a mapper for avro compression codecs
> ----------------------------------------------
>
> Key: SPARK-45711
> URL: https://issues.apache.org/jira/browse/SPARK-45711
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 4.0.0
> Reporter: Jiaan Geng
> Assignee: Jiaan Geng
> Priority: Major
>
> Currently, Spark supported all the avro compression codecs, but the avro
> supported compression codecs and spark supported are not completely
> one-on-one due to Spark introduce the compression codecs UNCOMPRESSED.
> There are a lot of magic strings copy from orc compression codecs. This issue
> lead to developers need to manually maintain its consistency. It is easy to
> make mistakes and reduce development efficiency.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
