ivandika3 opened a new pull request, #8020: URL: https://github.com/apache/ozone/pull/8020
## What changes were proposed in this pull request? From AWS Java SDK V2 2.30.0, The SDK automatically uses the CRC32 algorithm to calculate the checksum and provides it in the request. This will make default S3 PutObject and UploadPart requests to add a checksum trailer in the request body (e.g. `x-amz-checksum-crc32:ZS91yQ==`). The solution contains two parts: 1. Handle the trailer variants of the signature algorithm (e.g. `STREAMING-AWS4-HMAC-SHA256-PAYLOAD-TRAILER`) to also use `SignedChunksInputStream` and the `x-amz-decoded-content-length` 2. Change all `IOUtils#copy` to `IOUtils#copyLarge(final InputStream input, final OutputStream output, final long inputOffset, final long length, final byte[] buffer)` which specifies the length to `x-amz-decoded-content-length` so that the trailer is excluded. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-12488 ## How was this patch tested? Add AWS SDK V2 integration tests for PutObject, UploadPart (MultipartUpload), and CopyObject. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
