MartijnVisser opened a new pull request, #29832:
URL: https://github.com/apache/flink/pull/29832
## What is the purpose of the change
Hadoop before 3.4.3 fails on Java 23 and later (HADOOP-19212), so this makes
3.4.3 the minimum and default Hadoop version for every Java version.
## Brief change log
- Default `flink.hadoop.version` to 3.4.3 and remove the java25 override
- Fold the `hadoop3-tests` profiles into the default build and remove the
dependency pins that 3.4.3 no longer needs
- Remove the Hadoop 2.10.2 CI flags and the now duplicate Hadoop 3.4.3
nightly stages
- Run the secure YARN Docker cluster on Hadoop 3.4.3 and Ubuntu focal, as
its container-executor needs OpenSSL 1.1
- Use the AWS SDK v2 modules instead of the 686 MB bundle in the
flink-yarn S3 test, and remove the duplicate `include_hadoop_aws` profile
- Update the docs
## Verifying this change
This change is already covered by existing tests, such as:
- The tests of the affected modules on Java 17, including
flink-yarn-tests, and the flink-orc and flink-fs-tests tests on Java 25
- The dependency convergence check on Java 11, 17 and 21
- cron_hadoop343, which ran the new default and was green on the last 7
Azure nightlies
- `YarnFileStageTestS3ITCase`, which passes against a local SeaweedFS once
its skip is fixed locally (FLINK-41391)
- The secure YARN Docker cluster, which comes up (its e2e test is disabled)
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): yes
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: no
- The serializers: no
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: yes
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? not applicable
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes (please specify the tool below)
Generated-by: Claude Code (Claude Opus 5.5)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
