yihua opened a new pull request, #19365: URL: https://github.com/apache/hudi/pull/19365
### Describe the issue this Pull Request addresses Closes #19364 Apache Spark 4.2.0 has been officially released (GA). Hudi's `spark4.2` profile currently builds against `4.2.0-preview4` (added in #18621). This PR upgrades the Spark 4.2 dependency to the GA release. ### Summary and Changelog - `pom.xml` `spark4.2` profile: `spark42.version` `4.2.0-preview4` to `4.2.0`; `hadoop.version` `3.4.3` to `3.5.0`; `lz4.version` (`at.yawk.lz4:lz4-java`) `1.10.4` to `1.11.0`. The hadoop and lz4 bumps match the versions Spark 4.2.0 GA ships, verified by diffing Spark's parent POM (all other transitive versions, Scala/Parquet/ORC/Avro/Jackson/Kafka/Log4j/slf4j/antlr, are unchanged between preview4 and GA). - CI bundle-validation base image renamed `flink1200hive313spark420previewscala213` to `flink1200hive313spark420scala213`, rebuilt with `SPARK_VERSION=4.2.0` and `HADOOP_VERSION=3.5.0`. The new base image must be published to `apachehudi/hudi-ci-bundle-validation-base` (see #18548 for the process) before the Spark 4.2 CI jobs can go green. - Spark 4.2 runtime string `spark4.2.0-preview4` to `spark4.2.0` across `ci_run.sh`, `run_docker_java17.sh`, `validate.sh`, `.github/workflows/bot.yml`, and the `.asf.yaml` required status checks. ### Impact Hudi's Spark 4.2 support now targets the GA release instead of a preview. Behavior on Spark 3.x, 4.0, and 4.1 is unchanged. ### Risk Level low. Changes are confined to the version-gated `spark4.2` profile and its CI wiring. Spark 4.2.0, `hadoop-client-api` 3.5.0, and `lz4-java` 1.11.0 all resolve transitively from Maven Central, and full compile plus bundle validation plus docker-java17 test run in the Spark 4.2 CI matrix. ### Documentation Update none ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Enough context is provided in the sections above - [ ] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
