[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17187849#comment-17187849
]
Chao Sun commented on SPARK-27733:
----------------------------------
bq. BTW, is Hive community will to introduce the version upgrade of Avro in
their 2.3.x?
It seems non-trivial to upgrade Avro in Hive (see HIVE-21737). Maybe we can
shade Avro in Hive first so it won't cause conflicts? Even for that we may need
to first enable CI for Hive branch 2.3 (see
https://github.com/apache/hive/pull/1398). After these we can cut a release and
do a vote in the community.
> Upgrade to Avro 1.10.0
> ----------------------
>
> Key: SPARK-27733
> URL: https://issues.apache.org/jira/browse/SPARK-27733
> Project: Spark
> Issue Type: Improvement
> Components: Build, SQL
> Affects Versions: 3.1.0
> Reporter: Ismaël Mejía
> Priority: Minor
>
> Avro 1.9.2 was released with many nice features including reduced size (1MB
> less), and removed dependencies, no paranamer, no shaded guava, security
> updates, so probably a worth upgrade.
> Avro 1.10.0 was released and this is still not done.
> There is at the moment (2020/08) still a blocker because of Hive related
> transitive dependencies bringing older versions of Avro, so we could say that
> this is somehow still blocked until HIVE-21737 is solved.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
