alamb commented on issue #402: URL: https://github.com/apache/arrow-rs-object-store/issues/402#issuecomment-2950505673
I agree an extra request to infer a region is non ideal, but it is a lot more user friendly than the current behavior. Since the current client already follows HTTP redirects, extending that mechanism to work with S3 regions would be consistent in my mind, but that is definitely an opinion and I can see how others would differ. Another potential API: 1. Automatically follow any redirects to update the region/url (so the request always works, even if the region is misconfigured) 2. Add `AmazonS3Builder::disable_region_redirect` that explicitly disables this redirection Then best practice for performance would be to set `disable_region_redirect` > But you also have a mismatch between the states at which the Store is mutable, no? If you have an S3Store under an Arc<dyn ObjectStore>, then you can't assign the region at that point. Yeah, if we wanted to cache the redirect result, we would have to have some `Mutex` or something which sounds like a mess. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
