shangeyao opened a new issue, #11173: URL: https://github.com/apache/seatunnel/issues/11173
## Description This issue aims to add support for Apache Spark 4.1.x to SeaTunnel, enabling users to run SeaTunnel jobs on the latest Spark version. ## Background Apache Spark 4.1 has been released with several improvements and new features. SeaTunnel should support this version to stay up-to-date with the Spark ecosystem. ## Changes Required 1. Add `seatunnel-translation-spark-4.1` module for Spark 4.1 translation layer 2. Add `seatunnel-spark-4.1-starter` module for Spark 4.1 job submission 3. Update Spark version property to 4.1.2 4. Adapt to Spark 4.1 API changes (e.g., `useCommitCoordinator()` method in BatchWrite) ## Compatibility - Scala version: 2.13 - Spark version: 4.1.2 - Existing Spark 2.4 and 3.3 modules remain unchanged ## Testing - Unit tests pass for both new modules - Build verification successful -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
