amoeba commented on PR #33918: URL: https://github.com/apache/arrow/pull/33918#issuecomment-1411121662
Hey @cboettig, I'm not sure what the best course of action is here but thank you for the PR and discussion. I think we have to keep breaking changes in mind, which makes this more challenging. As far as how other S3 libraries handle this, there seems to be two broad categories: (1) SDKs and (2) higher-level applications. The SDKs tend not to offer region guessing and instead will error out if region isn't provided one way or another whereas higher level applications like s3fs will look up region for you. I consider the arrow R package to be a higher level application rather than an SDK so I think it makes sense that we have the machinery we do (both in the R package and in Arrow C++) for region detection. Related, I'm not sure we'd want to add any region-detection code into the R package because we already offer a more advanced facility for this in Arrow C++. I've tried a few alternative ways to fix the very valid issues you bring up while also not breaking the API and I'm not there yet. I might ask @thisisnic and @paleolimbot to have a look too if they can spare the time and I will return to this when I have time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
