>From Ritik Raj <[email protected]>:
Attention is currently required from: Michael Blow, Ritik Raj.
Hello Anon. E. Moose #1000171, Jenkins,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/20549?usp=email
to look at the new patch set (#5).
The following approvals got outdated and were removed:
Contrib-2 by Anon. E. Moose #1000171, Integration-Tests+1 by Jenkins,
Verified+1 by Jenkins, Verified-1 by Anon. E. Moose #1000171
Change subject: [ASTERIXDB-3669][CLOUD] Introduced S3 sync client for parallel
downloader
......................................................................
[ASTERIXDB-3669][CLOUD] Introduced S3 sync client for parallel downloader
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
Some S3-compatible object storage systems
do not support the S3 CRT or Async clients.
This patch introduces a synchronous S3 client
implementation for the parallel downloader,
which serves as a fallback in such cases
to ensure compatibility and reliability.
Additionally, a new configuration option has been
added to allow selection of the desired parallel
downloader client type (CRT, Async, or Sync).
Also, Introduced s3 client read timeout config.
Ext-ref: MB-69226
Change-Id: Id16c530916e7e223201e2395d7aa38a4640367b6
---
M
asterixdb/asterix-app/src/main/java/org/apache/asterix/app/config/ConfigValidator.java
M
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/IParallelDownloader.java
M
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3ClientConfig.java
M
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3CloudClient.java
M
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3ParallelDownloader.java
A
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/aws/s3/S3SyncDownloader.java
M
asterixdb/asterix-cloud/src/main/java/org/apache/asterix/cloud/clients/azure/blobstorage/AzureParallelDownloader.java
M
asterixdb/asterix-cloud/src/test/java/org/apache/asterix/cloud/s3/LSMS3Test.java
M
asterixdb/asterix-common/src/main/java/org/apache/asterix/common/config/CloudProperties.java
9 files changed, 282 insertions(+), 23 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/49/20549/5
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/20549?usp=email
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings?usp=email
Gerrit-MessageType: newpatchset
Gerrit-Project: asterixdb
Gerrit-Branch: phoenix
Gerrit-Change-Id: Id16c530916e7e223201e2395d7aa38a4640367b6
Gerrit-Change-Number: 20549
Gerrit-PatchSet: 5
Gerrit-Owner: Ritik Raj <[email protected]>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <[email protected]>
Gerrit-CC: Michael Blow <[email protected]>
Gerrit-Attention: Michael Blow <[email protected]>
Gerrit-Attention: Ritik Raj <[email protected]>
