This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 681fdd33463 [fix](s3-client) Fix s3-client max-connection default
value which cause s3 to be slow and unable to handle high concurrency in
many-files scenarios. (#58511)
681fdd33463 is described below
commit 681fdd33463adacd76334344c9ceda72d8b022d4
Author: Qi Chen <[email protected]>
AuthorDate: Tue Dec 2 15:58:27 2025 +0800
[fix](s3-client) Fix s3-client max-connection default value which cause s3
to be slow and unable to handle high concurrency in many-files scenarios.
(#58511)
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: #51825, #58514
Problem Summary:
### Release note
Fix s3-client max-connection default value introduced by #51825 which
cause s3 to be slow and unable to handle high concurrency in many-files
scenarios.
---
be/src/util/s3_util.cpp | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git a/be/src/util/s3_util.cpp b/be/src/util/s3_util.cpp
index fdb576fbcfb..a7cd1eff04c 100644
--- a/be/src/util/s3_util.cpp
+++ b/be/src/util/s3_util.cpp
@@ -369,8 +369,7 @@ std::shared_ptr<io::ObjStorageClient>
S3ClientFactory::_create_s3_client(
if (s3_conf.max_connections > 0) {
aws_config.maxConnections = s3_conf.max_connections;
} else {
- // AWS SDK max concurrent tcp connections for a single http client to
use. Default 25.
- aws_config.maxConnections =
std::max(config::doris_scanner_thread_pool_thread_num, 25);
+ aws_config.maxConnections = 102400;
}
aws_config.requestTimeoutMs = 30000;
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
