This is an automated email from the ASF dual-hosted git repository.
stevel pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new 8606b2c HADOOP-17869. `fs.s3a.connection.maximum` should be bigger
than `fs.s3a.threads.max` (#3337).
8606b2c is described below
commit 8606b2cddd65964ca216d3610dede78c9515abdb
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon Aug 30 10:30:43 2021 -0700
HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than
`fs.s3a.threads.max` (#3337).
The value of `fs.s3a.connection.maximum` has been increased to 96
Contributed by Dongjoon Hyun
Change-Id: I9020a2bfd2a67fa7a2ec0598ed9d63e78ee99c73
---
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | 2 +-
.../hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git
a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
index 1274830..88d8220 100644
--- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
+++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
@@ -1372,7 +1372,7 @@
<property>
<name>fs.s3a.connection.maximum</name>
- <value>48</value>
+ <value>96</value>
<description>Controls the maximum number of simultaneous connections to S3.
This must be bigger than the value of fs.s3a.threads.max so as to stop
threads being blocked waiting for new HTTPS connections.
diff --git
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
index b741bc2..e51d8ab 100644
---
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
+++
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
@@ -147,7 +147,7 @@ public final class Constants {
// number of simultaneous connections to s3
public static final String MAXIMUM_CONNECTIONS = "fs.s3a.connection.maximum";
- public static final int DEFAULT_MAXIMUM_CONNECTIONS = 48;
+ public static final int DEFAULT_MAXIMUM_CONNECTIONS = 96;
// connect to s3 over ssl?
public static final String SECURE_CONNECTIONS =
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
