[
https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013663#comment-17013663
]
Vinoth Chandar commented on HUDI-91:
------------------------------------
Shading spark-avro is tricky, since there could be mismatches when spark
version changes.. Simply speaking, we are dropping support for older < 2.4
versions with this change..
We could do what you suggest - maintain our own internal implementation.. I
feel that is just more maintenance overhead and we are better off reusing
spark-avro .. Thoughts?
> Replace Databricks spark-avro with native spark-avro #628
> ---------------------------------------------------------
>
> Key: HUDI-91
> URL: https://issues.apache.org/jira/browse/HUDI-91
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: Spark Integration, Usability
> Reporter: Vinoth Chandar
> Assignee: Udit Mehrotra
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.5.1
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> [https://github.com/apache/incubator-hudi/issues/628]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
