[
https://issues.apache.org/jira/browse/HUDI-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17514290#comment-17514290
]
Ethan Guo commented on HUDI-3681:
---------------------------------
Per discussion, we'll keep the current hudi-utilities-bundle as is
(hudi-utilities-bundle_2.11, hudi-utilities-bundle_2.12), and create two new
"thin" utilities bundles (scala 2.11, 2.12) excluding spark dependencies. The
use case is that, if user encounters compatibility issue from
hudi-utilities-bundle with Spark, the new "thin" utilities bundle + hudi spark
bundle can be used together. This avoids exploding the number of
hudi-utilities-bundle jars and artifacts we publish.
> Provision additional bundles aliased to Spark minor version
> -----------------------------------------------------------
>
> Key: HUDI-3681
> URL: https://issues.apache.org/jira/browse/HUDI-3681
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Alexey Kudinkin
> Assignee: Ethan Guo
> Priority: Blocker
> Fix For: 0.11.0
>
>
> To follow on the updated model of compatibility with Spark, we need to
> provision additional bundles as part of the 0.11 release referencing Spark
> minor version in the bundle name ("spark3.1", "spark3.2", "spark2.4")
> As such following bundles will be released in 0.11
> * "spark2.4" (Scala 2.11/2.12)
> * "spark3.1"
> * "spark3.2"
> * "spark3" (this is the same as "spark3.2")
> * "spark2" (Scala 2.11/2.12, this is the same as "spark2.4")
--
This message was sent by Atlassian Jira
(v8.20.1#820001)