Stephen Patel created BEAM-14011:
------------------------------------
Summary: AWS SDK2 S3FileSystem MultiPart Copy sets incorrect
request parameters
Key: BEAM-14011
URL: https://issues.apache.org/jira/browse/BEAM-14011
Project: Beam
Issue Type: Bug
Components: io-java-aws
Affects Versions: 2.36.0, 2.35.0, 2.34.0, 2.33.0, 2.32.0, 2.31.0, 2.30.0,
2.29.0
Reporter: Stephen Patel
The following code locations use incorrect parameters:
[Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L518-L519]
and
[Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L539-L540]
specifies the sourcePath instead of the destinationPath.
[Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L541]
specifies destinationPath.getBucket() instead of sourcePath.getBucket()
[Here|https://github.com/apache/beam/blob/v2.36.0/sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/s3/S3FileSystem.java#L556]
specifies a constant part number of 1, instead of using the partNumber
variable.
Taken together, these issues cause multipart copies to fail due to:
{noformat}
software.amazon.awssdk.services.s3.model.NoSuchUploadException: The specified
upload does not exist. The upload ID may be invalid, or the upload may have
been aborted or completed.
{noformat}
If the object references are fixes, the part number issue causes multipart
copies to fail due to:
{noformat}
software.amazon.awssdk.services.s3.model.S3Exception: The list of parts was not
in ascending order. Parts must be ordered by part number.
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
