[
https://issues.apache.org/jira/browse/BEAM-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17132386#comment-17132386
]
Beam JIRA Bot commented on BEAM-2556:
-------------------------------------
This issue is assigned but has not received an update in 30 days so it has been
labeled "stale-assigned". If you are still working on the issue, please give an
update and remove the label. If you are no longer working on the issue, please
unassign so someone else may work on it. In 7 days the issue will be
automatically unassigned.
> Client-side throttling for Datastore connector
> ----------------------------------------------
>
> Key: BEAM-2556
> URL: https://issues.apache.org/jira/browse/BEAM-2556
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Colin Phipps
> Assignee: Colin Phipps
> Priority: P3
> Labels: datastore, stale-assigned
>
> The Datastore connector currently has exponential backoff on errors, which is
> good. But it does not do any other throttling of its write load in response
> to errors; once a request succeeds, it resumes writing as quickly as it can.
> Write loads will be more stable and more likely to compete if the client
> throttles itself in the event that it receives high rates of errors from the
> Datastore service; specifically
> https://landing.google.com/sre/book/chapters/handling-overload.html#client-side-throttling-a7sYUg
> is a technique that Google has had success with on other services.
> We (Datastore) have a patch in progress to add this behaviour to the
> connector.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
