yihua opened a new pull request, #20428: URL: https://github.com/apache/hudi/pull/20428
### Describe the issue this Pull Request addresses closes #20427 Hudi compiles against Spark 3.5.9, but most bundle validation lanes still run on Spark 3.5.1. Comet 1.1.0 in the Spark native bundle needs Spark 3.5.2 or later at runtime, so the native bundle validation fails on master since the base image moved to glibc (#20417). ### Summary and Changelog Every bundle validation lane that ran on Spark 3.5.1 now runs on 3.5.9: the PR CI lanes, the release candidate validation and the Maven artifact validation. The `spark35.version` dependency is already 3.5.9 (#19884), so the runtime now matches it. `ci_run.sh` folds the 3.5.1 cases into the 3.5.9 ones, and the five base image build scripts in use are renamed to their `spark359` tags. ### Impact CI only. No change to the published artifacts. ### Risk Level low CI pulls the base images by tag, so the five new `spark359` tags have to be built from the renamed scripts and pushed to Docker Hub before these lanes can go green: `flink1200hive313spark359scala213`, `flink221hive313spark359` (PR CI), and `flink1190hive313spark359scala213`, `flink200hive313spark359`, `flink211hive313spark359` (release workflows). `flink1200hive313spark359` already exists. ### Documentation Update none ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Enough context is provided in the sections above - [ ] Adequate tests were added if applicable -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
