dentiny opened a new issue, #7189: URL: https://github.com/apache/opendal/issues/7189
### Feature Description Hi team, I've suffered tail latency in my production environment, to cut down tail latency. Reference: https://research.google/pubs/the-tail-at-scale/ ### Problem and Solution Having hedged request, which issues duplicate request (potentially to another serving host, or using another TCP connection) will improve tail latency. Different from the timeout configurations, with hedged request there're actually multiple on-the-flight requests; the client (opendal here) serves with the earliest arriving response, and properly manages the lifecycle for all ongoing requests. Notice hedged request should only support idempotent operations, mostly it means read-only operations. ### Additional Context It's related to another feature request issue I proposed: https://github.com/apache/opendal/issues/7168 I would like to have per-operation configuration, like timeout and hedged request trigger threshold. ### Are you willing to contribute to the development of this feature? - [ ] Yes, I am willing to contribute to the development of this feature. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
