This is an automated email from the ASF dual-hosted git repository.
dongjoon-hyun pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new ee0b8ac [SPARK-59904] Upgrade Iceberg to 1.12.0 in integration tests
ee0b8ac is described below
commit ee0b8ace6f89433c3ebb080cdcd1df5aae0b846a
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Sep 30 13:59:58 2026 -0700
[SPARK-59904] Upgrade Iceberg to 1.12.0 in integration tests
### What changes were proposed in this pull request?
This PR aims to upgrade `Iceberg` to 1.12.0 in integration tests.
### Why are the changes needed?
To test against the latest Apache Iceberg release.
- https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.12.0
(2026-09-30)
- https://github.com/apache/iceberg/pull/14984
### Does this PR introduce _any_ user-facing change?
No, this is a test-only change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 5.5
Closes #580 from dongjoon-hyun/SPARK-59904.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/build_and_test.yml | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index 3aa0f63..777af35 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -287,7 +287,7 @@ jobs:
- name: Test
run: |
cd /tmp/spark/sbin
- ./start-connect-server.sh --packages
org.apache.spark:spark-connect_2.13:4.0.4,org.apache.iceberg:iceberg-spark-runtime-4.0_2.13:1.11.0
-c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c
spark.sql.catalog.local.type=hadoop -c
spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c
spark.sql.defaultCatalog=local
+ ./start-connect-server.sh --packages
org.apache.spark:spark-connect_2.13:4.0.4,org.apache.iceberg:iceberg-spark-runtime-4.0_2.13:1.12.0
-c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c
spark.sql.catalog.local.type=hadoop -c
spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c
spark.sql.defaultCatalog=local
# Iceberg jars are resolved at startup, so wait until the server is
ready.
for i in $(seq 1 12); do
grep -q "Spark Connect server started at" /tmp/spark/logs/*.out
2>/dev/null && break
@@ -321,7 +321,7 @@ jobs:
- name: Test
run: |
cd /tmp/spark/sbin
- ./start-connect-server.sh --packages
org.apache.spark:spark-connect_2.13:4.1.3,org.apache.iceberg:iceberg-spark-runtime-4.1_2.13:1.11.0
-c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c
spark.sql.catalog.local.type=hadoop -c
spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c
spark.sql.defaultCatalog=local
+ ./start-connect-server.sh --packages
org.apache.spark:spark-connect_2.13:4.1.3,org.apache.iceberg:iceberg-spark-runtime-4.1_2.13:1.12.0
-c spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog -c
spark.sql.catalog.local.type=hadoop -c
spark.sql.catalog.local.warehouse=/tmp/spark/warehouse -c
spark.sql.defaultCatalog=local
# Iceberg jars are resolved at startup, so wait until the server is
ready.
for i in $(seq 1 12); do
grep -q "Spark Connect server started at" /tmp/spark/logs/*.out
2>/dev/null && break
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
