[
https://issues.apache.org/jira/browse/HADOOP-19357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manika Joshi updated HADOOP-19357:
----------------------------------
Description:
Given the significant improvements on the service side over the past few years,
the current client-side retry mechanism, which enforces 5-6 minutes of sleep
time with jitter, is now excessive. Therefore, we are realigning the retry and
throttling logic thresholds.
Since the service can now handle higher traffic rates, we aim to enhance driver
performance by setting the following configurations as default:
* {*}Client-side throttling (CST){*}: Off
* *Client Backoff* - 500ms (reduced from 3sec)
* *Max Backoff* - 25s (reduced from 30sec)
* *Min Backoff* - 500ms (reduced from 3sec)
was:
Given the significant improvements on the service side over the past few years,
the current client-side retry mechanism, which enforces 5-6 minutes of sleep
time with jitter, is now excessive. Therefore, we are realigning the retry and
throttling logic thresholds.
Since the service can now handle higher traffic rates, we aim to enhance driver
performance by setting the following configurations as default:
* {*}Client-side throttling (CST){*}: Off
* *Client Backoff* - 500ms
* *Max Backoff* - 25s
* *Min Backoff* - 500ms
> ABFS: Optimizations for Retry Handling and Throttling
> -----------------------------------------------------
>
> Key: HADOOP-19357
> URL: https://issues.apache.org/jira/browse/HADOOP-19357
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/azure
> Affects Versions: 3.4.0, 3.4.1
> Reporter: Manika Joshi
> Assignee: Manika Joshi
> Priority: Minor
> Labels: pull-request-available
>
> Given the significant improvements on the service side over the past few
> years, the current client-side retry mechanism, which enforces 5-6 minutes of
> sleep time with jitter, is now excessive. Therefore, we are realigning the
> retry and throttling logic thresholds.
> Since the service can now handle higher traffic rates, we aim to enhance
> driver performance by setting the following configurations as default:
> * {*}Client-side throttling (CST){*}: Off
> * *Client Backoff* - 500ms (reduced from 3sec)
> * *Max Backoff* - 25s (reduced from 30sec)
> * *Min Backoff* - 500ms (reduced from 3sec)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
