This is an automated email from the ASF dual-hosted git repository.
stevel pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 265a48e HADOOP-17869. `fs.s3a.connection.maximum` should be bigger
than `fs.s3a.threads.max` (#3337).
265a48e is described below
commit 265a48e245b4094be1a8423a74822b38b9eb9d2a
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon Aug 30 10:30:43 2021 -0700
HADOOP-17869. `fs.s3a.connection.maximum` should be bigger than
`fs.s3a.threads.max` (#3337).
The value of `fs.s3a.connection.maximum` has been increased to 96
Contributed by Dongjoon Hyun
---
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml | 2 +-
.../hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git
a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
index 15075a4..e1ddedd 100644
--- a/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
+++ b/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
@@ -1381,7 +1381,7 @@
<property>
<name>fs.s3a.connection.maximum</name>
- <value>48</value>
+ <value>96</value>
<description>Controls the maximum number of simultaneous connections to S3.
This must be bigger than the value of fs.s3a.threads.max so as to stop
threads being blocked waiting for new HTTPS connections.
diff --git
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
index ea3de1d..8bd0291 100644
---
a/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
+++
b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
@@ -147,7 +147,7 @@ public final class Constants {
// number of simultaneous connections to s3
public static final String MAXIMUM_CONNECTIONS = "fs.s3a.connection.maximum";
- public static final int DEFAULT_MAXIMUM_CONNECTIONS = 48;
+ public static final int DEFAULT_MAXIMUM_CONNECTIONS = 96;
// connect to s3 over ssl?
public static final String SECURE_CONNECTIONS =
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
