[
https://issues.apache.org/jira/browse/HADOOP-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312033#comment-15312033
]
Steve Loughran commented on HADOOP-13211:
-----------------------------------------
Sorry, I wasn't clear
# yes, we should have retry mechanisms
# the code in the IPC for retry policies may be all you need to start
# otherwise, look at what is there, pick it up.
# With tests. Maybe mocking will help here
regarding data loss on retry, it'd be upload where retries would help reduce
the risk
> Swift driver should have a configurable retry feature when ecounter 5xx error
> -----------------------------------------------------------------------------
>
> Key: HADOOP-13211
> URL: https://issues.apache.org/jira/browse/HADOOP-13211
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/swift
> Affects Versions: 2.7.2
> Reporter: Chen He
> Assignee: Chen He
>
> In current code. if Swift driver meets a HTTP 5xx, it will throw exception
> and stop. As a driver, it will be more sophisticate if it can retry a
> configurable times before report failure. There are two reasons that I can
> image:
> 1. if the server is really busy, it is possible that the server will drop
> some requests to avoid DDoS attack.
> 2. If server accidentally unavailable for a short period of time and come
> back again, we may not need to fail the whole driver. Just record the
> exception and retry may be more flexible.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
