malinjawi opened a new pull request, #11924: URL: https://github.com/apache/gluten/pull/11924
## What changes are proposed in this pull request? This PR adds native Delta Lake write support for Spark 4.0 + Delta 4.0 in the Velox backend. Main changes: - Add Delta 4 write offload integration in Delta write operators and command offload path. - Wire Delta-specific parquet file format and optimistic transaction write path for native execution. - Add native write statistics tracking plumbing used by Delta write. - Add Delta optimized writer offload integration for the Delta 4 path. Scope note: - This PR is focused on native write support only. - Delta 4 test-suite expansion is split into separate PR(s) for reviewability. Part of #10215. ## How was this patch tested? - Compile/build validation with Spark 4.0 + Delta 4 profile: ```bash ./build/mvn -pl backends-velox -am -Pbackends-velox,delta,spark-4.0,scala-2.13,java-17 -DskipTests -Dcheckstyle.skip=true -Dspotless.skip=true -Dscalastyle.skip=true compile -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
