[
https://issues.apache.org/jira/browse/HADOOP-16618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259830#comment-17259830
]
Steve Loughran commented on HADOOP-16618:
-----------------------------------------
also: socket buffer sizes
> increase the default number of threads and http connections in S3A
> ------------------------------------------------------------------
>
> Key: HADOOP-16618
> URL: https://issues.apache.org/jira/browse/HADOOP-16618
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.2.1
> Reporter: Steve Loughran
> Priority: Major
>
> Enable bigger thread and http pools in the S3A connector, especially now that
> the transfer manager is doing parallel block transfer, as is rename()
> We can make a lot more with parallelism in a single thread, and for
> applications with multiple worker threads, we need bigger defaults
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
