>From Ritik Raj <[email protected]>: Attention is currently required from: Hussain Altowileb, Michael Blow, Preetham Poluparthi.
Ritik Raj has uploaded a new patch set (#14) to the change originally created by Preetham Poluparthi. ( https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/21277?usp=email ) The following approvals got outdated and were removed: Integration-Tests+1 by Jenkins, Verified+1 by Jenkins Change subject: [ASTERIXDB-3768][CLOUD] Add S3 legacy MD5 and disable chunked encoding knobs ...................................................................... [ASTERIXDB-3768][CLOUD] Add S3 legacy MD5 and disable chunked encoding knobs - user model changes: yes - storage format changes: no - interface changes: yes Add isS3LegacyMd5ChecksumEnabled() and isS3ChunkedEncodingDisabled() to ICloudProperties. In CloudProperties the legacy MD5 knob defaults to true when a custom endpoint is set and false for native AWS S3, while chunked encoding stays enabled by default. S3ClientConfig carries both flags and S3CloudClient applies them independently of the checksum behavior: it restores pre-2.30 Content-MD5 behavior via LegacyMd5Plugin and can disable chunked transfer encoding for S3-compatible stores. S3Utils (external data path) resolves both knobs per link, using the explicit parameter when present and an endpoint-aware default otherwise, independent of the resolved checksum behavior. S3CloudClient.deleteObjects requests an explicit CRC32C checksum when the checksum behavior is WHEN_REQUIRED. That mode suppresses the SDK's automatic integrity header, but DeleteObjects mandates one (Content-MD5 or a flexible checksum), which S3-compatible stores such as OCI Object Storage enforce. Ext-ref: MB-72035 Change-Id: I9443c9327a6bedb7e39c2ef1b729962b2237a974 --- M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1/cluster_state_1.1.regexadm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_full/cluster_state_1_full.1.regexadm M asterixdb/asterix-app/src/test/resources/runtimets/results/api/cluster_state_1_less/cluster_state_1_less.1.regexadm M asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3ClientConfig.java M asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3CloudClient.java M asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CloudProperties.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/aws/s3/S3Constants.java M asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/util/aws/s3/S3Utils.java M hyracks-fullstack/hyracks/hyracks-cloud/src/main/java/org/apache/hyracks/cloud/io/ICloudProperties.java M hyracks-fullstack/hyracks/hyracks-cloud/src/main/java/org/apache/hyracks/cloud/io/S3ChecksumBehavior.java 10 files changed, 116 insertions(+), 9 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/77/21277/14 -- To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/21277?usp=email To unsubscribe, or for help writing mail filters, visit https://asterix-gerrit.ics.uci.edu/settings?usp=email Gerrit-MessageType: newpatchset Gerrit-Project: asterixdb Gerrit-Branch: lumina Gerrit-Change-Id: I9443c9327a6bedb7e39c2ef1b729962b2237a974 Gerrit-Change-Number: 21277 Gerrit-PatchSet: 14 Gerrit-Owner: Preetham Poluparthi <[email protected]> Gerrit-Reviewer: Anon. E. Moose #1000171 Gerrit-Reviewer: Jenkins <[email protected]> Gerrit-CC: Hussain Altowileb <[email protected]> Gerrit-CC: Michael Blow <[email protected]> Gerrit-Attention: Hussain Altowileb <[email protected]> Gerrit-Attention: Michael Blow <[email protected]> Gerrit-Attention: Preetham Poluparthi <[email protected]>
