jrmccluskey commented on code in PR #39194:
URL: https://github.com/apache/beam/pull/39194#discussion_r3538883160
##########
sdks/java/ml/inference/remote/src/main/java/org/apache/beam/sdk/ml/inference/remote/RemoteInference.java:
##########
@@ -113,6 +130,30 @@ public Invoke<InputT, OutputT>
withBatchConfig(BatchElements.BatchConfig batchCo
return builder().setBatchConfig(batchConfig).build();
}
+ /** Configures the throttling delay when the client is preemptively
throttled. */
Review Comment:
Added the defaults + added a link to the AdaptiveThrottler class, which has
references to the SWE book.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]