[
https://issues.apache.org/jira/browse/HADOOP-16256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821257#comment-16821257
]
Shanthoosh Venkataraman commented on HADOOP-16256:
--------------------------------------------------
[~wheat9]
If external contributions are encouraged and welcome, then I can submit a patch
to fix this issue. We've identified this problem when localizing resources for
samza jobs from a slow HTTP server.
> HTTPFileSystem disallows users from configuring the connectionTimeout and
> readTimeout of HttpClient.
> ----------------------------------------------------------------------------------------------------
>
> Key: HADOOP-16256
> URL: https://issues.apache.org/jira/browse/HADOOP-16256
> Project: Hadoop Common
> Issue Type: Improvement
> Reporter: Shanthoosh Venkataraman
> Priority: Major
>
> HADOOP-14383 added a Hadoop filesystem API implementation to localize
> resources from artifactory for container localization.
> Currently HttpFileSystem uses the default HttpClient connectionTimeout and
> readTimeout, which is infinity in most JVM.
> When the http server is slow, this prolongs the execution time of the
> container localization phase and in some cases we've observed that it runs
> for hours.
> It would be better to choose reasonable defaults for connectionTimeout and
> readTimeout of HttpClient and allow users to configure them.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
