[ https://issues.apache.org/jira/browse/HUDI-519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071847#comment-17071847 ]
Vinoth Chandar commented on HUDI-519: ------------------------------------- this was done already IIUC.. right [~xleesf]? > Document the need for Avro dependency shading/relocation for custom payloads, > need for spark-avro > ------------------------------------------------------------------------------------------------- > > Key: HUDI-519 > URL: https://issues.apache.org/jira/browse/HUDI-519 > Project: Apache Hudi (incubating) > Issue Type: Task > Components: Docs, Usability > Reporter: Udit Mehrotra > Assignee: leesf > Priority: Major > Fix For: 0.6.0 > > > In [https://github.com/apache/incubator-hudi/pull/1005] we are migrating Hudi > to Spark 2.4.4. As part of this migration, we also had to migrate Hudi to use > Avro 1.8.2 (required by spark), while Hive still uses older version of Avro. > This has resulted in the need to shade Avro in *hadoop-mr-bundle*. This has > implications on users of Hudi, who implement custom record payloads. They > would have start shading Avro in there custom jars, similar to how it shaded > in *hadoop-mr-bundle*. > This Jira is to track the documentation of this caveat in release notes, and > if needed at other places like website etc. -- This message was sent by Atlassian Jira (v8.3.4#803005)