Kinrany opened a new issue, #268:
URL: https://github.com/apache/arrow-rs-object-store/issues/268

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   I'd like to limit the rate of requests I make to S3, to avoid running into 
throttling on their side.
   
   **Describe the solution you'd like**
   There could be a wrapper, similar to `ThrottledStore`, that puts requests in 
a queue and executes them up to specified throughput.
   
   **Describe alternatives you've considered**
   Rate limiting could be baked into ObjectStore implementations that need it, 
with rules and configuration that apply to them only. This might be better if 
there is a wide variety of rate limiting rules between different vendors. On 
the other hand, this is worse if, say, S3-compatible vendors have different 
rules between them.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to