alamb commented on issue #5143: URL: https://github.com/apache/arrow-rs/issues/5143#issuecomment-2358783137
@edmondop and I spoke about this at the NYC DataFUsion meetup yesterday I think the usecase is that 1. User uses object_store indirectly via `polars` 2. `polars` does not provide any way to modify / configure s3 connections at runtime If they could control the source, they could use the existing object_store [`CredentialProvider`](https://docs.rs/object_store/latest/object_store/trait.CredentialProvider.html) trait but they control neither the source or distribution @edmondop mentioned something about some AWS SDK mechanism that calls out to an external program / process to get credentials. While less efficient this would allow someone to plug in whatever authentication mechanism they wanted without having to change the source code Perhaps we can follow this model somehow and build a "get credentials from an external process / souce" into the object store to provide a way that did not require the aws sdk, nor a bug dependency tree, but could support arbitrary authentication 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
