This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi.git
The following commit(s) were added to refs/heads/master by this push:
new ef203e05c [KYUUBI #6452] Add cross test for Spark 4.0
ef203e05c is described below
commit ef203e05cb5b37c82b47c4383eeb17233bfd76fc
Author: Cheng Pan <[email protected]>
AuthorDate: Wed Jun 5 15:24:27 2024 +0800
[KYUUBI #6452] Add cross test for Spark 4.0
# :mag: Description
This PR adds Spark 4.0 cross-test for the Spark SQL engine - built against
Spark 3.5, run with Spark 4.0.
As Spark 4.0 requires Java 17 or 21, the cross test uses Java 17.
## Types of changes :bookmark:
- [ ] Bugfix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing
functionality to change)
## Test Plan ๐งช
Pass GHA.
---
# Checklist ๐
- [x] This patch was not authored or co-authored using [Generative
Tooling](https://www.apache.org/legal/generative-tooling.html)
**Be nice. Be informative.**
Closes #6452 from pan3793/xtest-4.0.
Closes #6452
c49883756 [Cheng Pan] Add cross test for Spark 4.0
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
.github/workflows/master.yml | 5 +++++
1 file changed, 5 insertions(+)
diff --git a/.github/workflows/master.yml b/.github/workflows/master.yml
index 0999b97ea..503e03147 100644
--- a/.github/workflows/master.yml
+++ b/.github/workflows/master.yml
@@ -71,6 +71,11 @@ jobs:
spark-archive:
'-Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-3.4.3
-Dspark.archive.name=spark-3.4.3-bin-hadoop3.tgz -Pzookeeper-3.6'
exclude-tags:
'-Dmaven.plugin.scalatest.exclude.tags=org.scalatest.tags.Slow,org.apache.kyuubi.tags.DeltaTest,org.apache.kyuubi.tags.IcebergTest,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.SparkLocalClusterTest'
comment: 'verify-on-spark-3.4-binary'
+ - java: 17
+ spark: '3.5'
+ spark-archive: '-Pscala-2.13
-Dspark.archive.mirror=https://archive.apache.org/dist/spark/spark-4.0.0-preview1
-Dspark.archive.name=spark-4.0.0-preview1-bin-hadoop3.tgz'
+ exclude-tags:
'-Dmaven.plugin.scalatest.exclude.tags=org.scalatest.tags.Slow,org.apache.kyuubi.tags.DeltaTest,org.apache.kyuubi.tags.IcebergTest,org.apache.kyuubi.tags.PaimonTest,org.apache.kyuubi.tags.SparkLocalClusterTest'
+ comment: 'verify-on-spark-4.0-binary'
exclude:
# SPARK-33772: Spark supports JDK 17 since 3.3.0
- java: 17
