Attila Doroszlai created HDDS-11109:
---------------------------------------

             Summary: Fail MPU earlier for too small part
                 Key: HDDS-11109
                 URL: https://issues.apache.org/jira/browse/HDDS-11109
             Project: Apache Ozone
          Issue Type: Improvement
          Components: s3gateway
            Reporter: Attila Doroszlai
            Assignee: Attila Doroszlai


Ozone requires S3 multipart upload parts to be at least 5MB, with the exception 
of the last part.  This requirement is enforced only while processing 
CompleteMultipartUpload request, because UploadPart request has no information 
about being the last part.

This may be improved: when receiving any but the very first part, one of the 
parts can verified (either the previous one, or the current one, depending on 
upload order and considering part replacement).

With normal upload order: receiving part N, we can verify part N-1 is 
acceptable.

Potential downsides:
# Use case that would no longer work: client uploads multiple undersized parts, 
but CompleteMultipartUpload lists only one of them, and at the last position; 
the rest are orphaned.
# May not be fully compatible with AWS.

https://github.com/apache/ozone/discussions/6869



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to