[ https://issues.apache.org/jira/browse/HADOOP-19485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17939736#comment-17939736 ]
ASF GitHub Bot commented on HADOOP-19485: ----------------------------------------- cnauroth commented on code in PR #7479: URL: https://github.com/apache/hadoop/pull/7479#discussion_r2021301416 ########## hadoop-tools/hadoop-aws/src/test/resources/log4j.properties: ########## @@ -102,3 +102,6 @@ log4j.logger.org.apache.hadoop.fs.s3a.S3AStorageStatistics=INFO # services it launches itself. # log4.logger.org.apache.hadoop.service=DEBUG +# log this at trace to trigger enabling the Review Comment: Is there more text intended here? e.g. "...enabling the AWS SDK metrics logging." > S3A: Upgrade AWS V2 SDK > ----------------------- > > Key: HADOOP-19485 > URL: https://issues.apache.org/jira/browse/HADOOP-19485 > Project: Hadoop Common > Issue Type: Sub-task > Components: build, fs/s3 > Affects Versions: 3.4.2 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Major > Labels: pull-request-available > > This SDK update doesn't need to come with some changes to disable some new > features (default integrity protections), > and to apply critical changes related to the SDK > Default integrity protection came with 2.30, and is on unless disabled. > https://github.com/aws/aws-sdk-java-v2/issues/5801 > As well as being incompatible with third party stores, it has also affected > S3 multiregion Access Points: > https://github.com/aws/aws-sdk-java-v2/issues/5878 > This has broken most interaction with third party stores, hence fixes in > Iceberg https://github.com/apache/iceberg/pull/12264 and Trinio > https://github.com/trinodb/trino/pull/24954 > There's also [AWS v2.30 SDK InputStream behavior changes #5859](AWS v2.30 SDK > InputStream behavior changes). > It looks like our code is safer from that, but it did require code review. > SDK 2.30.19 seems good with this -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org