tustvold commented on PR #513: URL: https://github.com/apache/arrow-rs-object-store/pull/513#issuecomment-3419830393
The default retry configuration should only retry 10 times? https://docs.rs/object_store/latest/src/object_store/client/retry.rs.html#248 Also with regards to rate limiting, full jitter is purportedly the optimal way to recover from such a scenario, as it better handles bursty load. That being said perhaps the base delay could be lengthened, but that'd worsen the recovery from 500 errors.... I think there's definitely a discussion about introducing new backoff behaviours, and allowing people to choose the one most applicable for their scenarios - I suspect there is no perfect solution -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
