[
https://issues.apache.org/jira/browse/HADOOP-16618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-16618:
------------------------------------
Parent: HADOOP-19353 (was: HADOOP-18477)
> increase the default number of threads and http connections in S3A
> ------------------------------------------------------------------
>
> Key: HADOOP-16618
> URL: https://issues.apache.org/jira/browse/HADOOP-16618
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.2.1
> Reporter: Steve Loughran
> Priority: Major
>
> Enable bigger thread and http pools in the S3A connector, especially now that
> the transfer manager is doing parallel block transfer, as is rename()
> We can make a lot more with parallelism in a single thread, and for
> applications with multiple worker threads, we need bigger defaults
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]