[ 
https://issues.apache.org/jira/browse/HADOOP-19485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17940390#comment-17940390
 ] 

ASF GitHub Bot commented on HADOOP-19485:
-----------------------------------------

ahmarsuhail commented on PR #7479:
URL: https://github.com/apache/hadoop/pull/7479#issuecomment-2772929843

   thanks @steveloughran , once this is in could you also give the CRT PR 
another look. Can cut the 3.4.2 branch by the end of the week hopefully, once 
these are in. What did you decide about conditional writes: 
https://github.com/apache/hadoop/pull/7011 , do we want to wait for that?




> S3A: Upgrade AWS V2 SDK to 2.29.52
> ----------------------------------
>
>                 Key: HADOOP-19485
>                 URL: https://issues.apache.org/jira/browse/HADOOP-19485
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: build, fs/s3
>    Affects Versions: 3.4.2
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Major
>              Labels: pull-request-available
>
> Upgrade to 2.29.52 -the last version compatible with third party stores until 
> there are fixes in the AWS SDK or workarounds added in the S3A connector
> This SDK update doesn't need to come with some changes to disable some new 
> features (default integrity protections),
> and to apply critical changes related to the SDK
> Default integrity protection came with 2.30, and is on unless disabled.
> https://github.com/aws/aws-sdk-java-v2/issues/5801
> As well as being incompatible with third party stores, it has also affected 
> S3 multiregion Access Points: 
> https://github.com/aws/aws-sdk-java-v2/issues/5878
> This has broken most interaction with third party stores, hence fixes in 
> Iceberg https://github.com/apache/iceberg/pull/12264 and Trinio 
> https://github.com/trinodb/trino/pull/24954
> There's also [AWS v2.30 SDK InputStream behavior changes #5859](AWS v2.30 SDK 
> InputStream behavior changes).
> It looks like our code is safer from that, but it did require code review.
> SDK 2.30.19 seems good with this



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to