deniskuzZ opened a new pull request, #6875:
URL: https://github.com/apache/hive/pull/6875
### What changes were proposed in this pull request?
`software.amazon.awssdk:apache5-client` is managed with `provided` scope in
the root pom, like the SDK `bundle` above it.
### Why are the changes needed?
HIVE-30127 (Iceberg 1.12) added `apache5-client` to the managed dependencies
without a scope and to `iceberg-handler`'s dependencies, so the distribution's
`lib` ships `apache5-client` and the SDK core jars it pulls in, unshaded:
`utils`, `http-client-spi`, `metrics-spi`, `annotations` (2.42.25). Hadoop's
S3A uses its own shaded SDK `bundle`. The standalone Tez AM (docker
`run_tezam`) puts Hive's `lib` before Hadoop's classpath, so on its first S3
call S3A loads `IoUtils` from Hive's `utils` jar and fails:
```
java.lang.NoSuchMethodError: 'void
software.amazon.awssdk.utils.IoUtils.closeQuietly(java.lang.AutoCloseable,
software.amazon.awssdk.thirdparty.org.slf4j.Logger)'
at software.amazon.awssdk.regions.util.HttpResourcesUtils.readResource
at
software.amazon.awssdk.auth.credentials.ContainerCredentialsProvider.refreshCredentials
at
org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider.getCredentials
...
at org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus
```
The AM exits and the pod crash-loops (apache/hive nightly of 2026-10-15 on
Kubernetes with S3).
With `provided`, `iceberg-handler` still compiles and tests with it and the
iceberg qtests declare it themselves (`test`), as `ql` and
`itests/qtest-iceberg` already do for the SDK `bundle`.
### Does this PR introduce _any_ user-facing change?
The distribution no longer ships the AWS SDK v2 jars. Iceberg's `S3FileIO`,
whose default HTTP client in 1.12 is Apache5, needs `apache5-client` on the
classpath or another `http-client.type`.
### How was this patch tested?
`mvn package -Pdist -DskipTests`: `lib` had `apache5-client`, `utils`,
`http-client-spi`, `metrics-spi` and `annotations` 2.42.25 before, none after.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
