[
https://issues.apache.org/jira/browse/HADOOP-19357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manika Joshi updated HADOOP-19357:
----------------------------------
Description:
Given the significant improvements on the service side over the past few years,
the current client-side retry mechanism, which enforces 5-6 minutes of sleep
time with jitter, is now excessive. Therefore, we are realigning the retry and
throttling logic thresholds.
Since the service can now handle higher traffic rates, we aim to enhance driver
performance by setting the following configurations as default:
* {*}Client-side throttling (CST){*}: Off
* *Client Backoff* - 500ms
* *Max Backoff* - 25s
* *Min Backoff* - 500ms
was:
Given the significant improvements on the service side over the past few years,
the current client-side retry mechanism, which enforces 5-6 minutes of sleep
time with jitter, is now excessive. Therefore, we are realigning the retry and
throttling logic thresholds.
Since the service can now handle higher traffic rates, we aim to enhance driver
performance by setting the following configurations as default:
* {*}Client-side throttling (CST){*}: Off
* *Client Backoff* - 500ms
* *Max Backoff* - 500ms
* *Min Backoff* - 500ms
> ABFS: Optimizations for Retry Handling and Throttling
> -----------------------------------------------------
>
> Key: HADOOP-19357
> URL: https://issues.apache.org/jira/browse/HADOOP-19357
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/azure
> Affects Versions: 3.4.0, 3.4.1
> Reporter: Manika Joshi
> Assignee: Manika Joshi
> Priority: Minor
>
> Given the significant improvements on the service side over the past few
> years, the current client-side retry mechanism, which enforces 5-6 minutes of
> sleep time with jitter, is now excessive. Therefore, we are realigning the
> retry and throttling logic thresholds.
> Since the service can now handle higher traffic rates, we aim to enhance
> driver performance by setting the following configurations as default:
> * {*}Client-side throttling (CST){*}: Off
> * *Client Backoff* - 500ms
> * *Max Backoff* - 25s
> * *Min Backoff* - 500ms
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
