akshaytayal opened a new issue, #13517: URL: https://github.com/apache/gluten/issues/13517
## Description Spark 4.3.0 has been released. Gluten should add initial Spark 4.3.x support, following the Spark 4.2.x support process in #12569 and the commit history convention in #11352. Spark 4.3.0 uses the same dependency versions as Spark 4.2.0, so no separate dependency alignment is needed. No Delta, Iceberg, Hudi or Paimon release supports Spark 4.3 yet, so those modules stay disabled on Spark 4.3 for now. ## Proposed work - [ ] **A.** Fix compatibility issues introduced by Spark 4.3 (version-agnostic code shared by all Spark profiles; needs no Spark 4.3 jars) - [ ] **B.** Add the Spark 4.3 shim layer and build profile (`shims/spark43`, `spark-4.3` profile, build-only CI job). Commits: `Spark: Move 4.2 as 4.3`, `Spark: Copy back 4.3 as 4.2`, `Spark: Initial support for 4.3.0`. Depends on A. - [ ] **C.** Add the Spark 4.3 unit test module (`gluten-ut/spark43`) and its CI jobs, with failing Spark 4.3 UTs disabled. Commits: `Spark: Move 4.2 UT as 4.3 UT`, `Spark: Copy back 4.3 UT as 4.2 UT`, `Spark: Initial support for 4.3.0 UT`. Depends on B. B and C keep the move/copy-back history, so they should be merged with rebase, not squash (#11352). ## Goal Initial support should focus on build, shim, and unit-test compatibility first. Native offload support for new Spark 4.3 features, and re-enabling the disabled Spark 4.3 UTs, can be handled in follow-up issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
