This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/spark-connect-swift.git
The following commit(s) were added to refs/heads/main by this push:
new a8c7c3b [SPARK-55195] Add `MacOS` integration test with Apache Spark
`4.2.0-preview1`
a8c7c3b is described below
commit a8c7c3b8b6ecc96e61f5460003d3ed7520b2ca06
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Tue Jan 27 10:14:21 2026 +0900
[SPARK-55195] Add `MacOS` integration test with Apache Spark
`4.2.0-preview1`
### What changes were proposed in this pull request?
This PR aims to add `MacOS` integration test with Apache Spark
`4.2.0-preview1`.
### Why are the changes needed?
To prepare for Spark 4.2.0 release. Specifically,
`spark.sql.timeType.enabled` is enabled explicitly in this test pipeline.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the CIs and check the logs.
<img width="469" height="45" alt="Screenshot 2026-01-26 at 17 09 19"
src="https://github.com/user-attachments/assets/08ec6af9-2880-4c7c-b398-05d99ced588a";
/>
-
https://github.com/apache/spark-connect-swift/actions/runs/21351058923/job/61447664659?pr=283
```
x spark-4.2.0-preview1-bin-hadoop3/
```
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #283 from dongjoon-hyun/SPARK-55195.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.github/workflows/build_and_test.yml | 19 +++++++++++++++++++
Tests/SparkConnectTests/DataFrameTests.swift | 3 ++-
2 files changed, 21 insertions(+), 1 deletion(-)
diff --git a/.github/workflows/build_and_test.yml
b/.github/workflows/build_and_test.yml
index ddd2a61..5c977db 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -135,6 +135,25 @@ jobs:
cd -
swift test --no-parallel -c release
+ integration-test-mac-spark42:
+ runs-on: macos-26
+ timeout-minutes: 20
+ env:
+ SPARK_LOCAL_IP: localhost
+ steps:
+ - uses: actions/checkout@v6
+ - name: Build
+ run: swift test --filter NOTHING -c release
+ - name: Test
+ run: |
+ curl -LO
https://www.apache.org/dyn/closer.lua/spark/spark-4.2.0-preview1/spark-4.2.0-preview1-bin-hadoop3.tgz?action=download
+ tar xvfz spark-4.2.0-preview1-bin-hadoop3.tgz && rm
spark-4.2.0-preview1-bin-hadoop3.tgz
+ mv spark-4.2.0-preview1-bin-hadoop3/ /tmp/spark
+ cd /tmp/spark/sbin
+ ./start-connect-server.sh -c spark.sql.timeType.enabled=true
+ cd -
+ swift test --no-parallel -c release
+
integration-test-mac:
runs-on: macos-26
timeout-minutes: 20
diff --git a/Tests/SparkConnectTests/DataFrameTests.swift
b/Tests/SparkConnectTests/DataFrameTests.swift
index 77568e4..27998c0 100644
--- a/Tests/SparkConnectTests/DataFrameTests.swift
+++ b/Tests/SparkConnectTests/DataFrameTests.swift
@@ -343,7 +343,8 @@ struct DataFrameTests {
@Test
func isLocal() async throws {
let spark = try await SparkSession.builder.getOrCreate()
- if !(await spark.version.starts(with: "4.1")) { // TODO(SPARK-52746)
+ let version = await spark.version
+ if !(version.starts(with: "4.1") || version.starts(with: "4.2")) { //
TODO(SPARK-52746)
#expect(try await spark.sql("SHOW DATABASES").isLocal())
#expect(try await spark.sql("SHOW TABLES").isLocal())
}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
