jorisvandenbossche commented on issue #38309: URL: https://github.com/apache/arrow/issues/38309#issuecomment-1830884926
> Some things don't quite fit into this picture, for example I'm not sure how to handle functions like `S3FileSystem.region()` and `resolve_s3_region()`. These use the S3 sdk (so we want to build it in the dedicated libarrow_s3fs.so module). However it provides functionality only relevant to S3 since local file systems don't have regions (so it cannot be retrieved from a registry of FromUri functions). Why is it a problem that the S3 filesystem has some additional APIs? I think this specific example of resolving a region is either used under the hood in FromUri (and then the generic interface doesn't need to know about it), or either used manually in an S3 specific API to resolve the region or to instantiate an S3FileSystem object. But those S3 specific APIs can still exist in the libarrow_s3fs.so library? (and those can be called by the user in code that is specific to S3) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
