[
https://issues.apache.org/jira/browse/HUDI-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17408480#comment-17408480
]
ASF GitHub Bot commented on HUDI-1869:
--------------------------------------
pengzhiwei2018 commented on pull request #3580:
URL: https://github.com/apache/hudi/pull/3580#issuecomment-911052610
> > spark 3.0.x will not supported as spark 3.1 has many changes to the
class interface.
>
> this is just crazy how badly it breaks across minor versions
If we want to both support spark 3.0 and spark 3.1, maybe way need another
build config to specify the spark version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Upgrading Spark3 To 3.1
> -----------------------
>
> Key: HUDI-1869
> URL: https://issues.apache.org/jira/browse/HUDI-1869
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Spark Integration
> Reporter: pengzhiwei
> Assignee: pengzhiwei
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> Spark 3.1 has changed some behavior of the internal class and interface for
> both spark-sql and spark-core module.
> Currently hudi can't compile success under the spark 3.1. We need support sql
> support for spark 3.1.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
