[
https://issues.apache.org/jira/browse/HUDI-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17411627#comment-17411627
]
ASF GitHub Bot commented on HUDI-1869:
--------------------------------------
pan3793 commented on a change in pull request #3580:
URL: https://github.com/apache/hudi/pull/3580#discussion_r703972302
##########
File path: pom.xml
##########
@@ -112,7 +112,7 @@
<sparkbundle.version>${spark2bundle.version}</sparkbundle.version>
<flink.version>1.13.1</flink.version>
<spark2.version>2.4.4</spark2.version>
- <spark3.version>3.0.0</spark3.version>
+ <spark3.version>3.1.0</spark3.version>
Review comment:
I would suggest always use the latest patched version, for this case,
Spark 2.4.8, 3.0.3, 3.1.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> Upgrading Spark3 To 3.1
> -----------------------
>
> Key: HUDI-1869
> URL: https://issues.apache.org/jira/browse/HUDI-1869
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Spark Integration
> Reporter: pengzhiwei
> Assignee: pengzhiwei
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> Spark 3.1 has changed some behavior of the internal class and interface for
> both spark-sql and spark-core module.
> Currently hudi can't compile success under the spark 3.1. We need support sql
> support for spark 3.1.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
