[ 
https://issues.apache.org/jira/browse/HUDI-519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17071847#comment-17071847
 ] 

Vinoth Chandar commented on HUDI-519:
-------------------------------------

this was done already IIUC.. right [~xleesf]? 

> Document the need for Avro dependency shading/relocation for custom payloads, 
> need for spark-avro
> -------------------------------------------------------------------------------------------------
>
>                 Key: HUDI-519
>                 URL: https://issues.apache.org/jira/browse/HUDI-519
>             Project: Apache Hudi (incubating)
>          Issue Type: Task
>          Components: Docs, Usability
>            Reporter: Udit Mehrotra
>            Assignee: leesf
>            Priority: Major
>             Fix For: 0.6.0
>
>
> In [https://github.com/apache/incubator-hudi/pull/1005] we are migrating Hudi 
> to Spark 2.4.4. As part of this migration, we also had to migrate Hudi to use 
> Avro 1.8.2 (required by spark), while Hive still uses older version of Avro.
> This has resulted in the need to shade Avro in *hadoop-mr-bundle*. This has 
> implications on users of Hudi, who implement custom record payloads. They 
> would have start shading Avro in there custom jars, similar to how it shaded 
> in *hadoop-mr-bundle*.
> This Jira is to track the documentation of this caveat in release notes, and 
> if needed at other places like website etc.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to