slfan1989 opened a new pull request, #2018:
URL: https://github.com/apache/auron/pull/2018
<!--
- Start the PR title with the related issue ID, e.g. '[AURON #XXXX] Short
summary...'.
-->
### Which issue does this PR close?
Closes #2017
### Rationale for this change
With Spark 4.0 and 4.1 support added to the project, the `dev/reformat`
script needs to be updated to handle formatting and style checks for these new
versions. Spark 4.x requires JDK 17+ and Scala 2.13, while Spark 3.x uses JDK 8
and Scala 2.12. The script should automatically switch between these
environments.
### What changes are included in this PR?
#### 1. Fix Flink Maven profile
- Before: -Pflink,flink-1.18
- After: -Pflink-1.18
- Reason: Avoid activating non-existent flink profile
#### 2.Add Spark 4.x support
- Add spark-4.0 and spark-4.1 to the version sweep list
- Auto-switch to scala-2.13 profile for Spark 4.x (Spark 4.x requires Scala
2.13)
- Auto-switch to JDK 17 for Spark 4.x (Spark 4.x requires JDK 17+)
- Auto-switch back to JDK 8 for Spark 3.x versions
#### 3.Update CI workflow (.github/workflows/style.yml)
- Add JDK 17 setup alongside existing JDK 8
- Enable style check to work with both Spark 3.x and Spark 4.x versions
### Are there any user-facing changes?
No.
### How was this patch tested?
Verified automatic JDK switching works for Spark 3.x (JDK 8) and Spark 4.x
(JDK 17)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
