kevinjqliu commented on issue #675: URL: https://github.com/apache/arrow-rs-object-store/issues/675#issuecomment-4663116231
I think enumerating object storage capabilities is interesting and helpful for callers. We just need to make sure the advertised capabilities are up to date with the latest behavior 😄, although object storage behaviors rarely change. One thing I want to point out is that capabilities might also be tied to the configured store instance, not just the object storage behavior. There are configs that can change behavior, and thus the capabilities. For example, [Azure's `list_with_offset`](https://github.com/apache/arrow-rs-object-store/blob/a9a83f18071d9e4c5636d379aaa0513c1e06d0d4/src/azure/mod.rs#L125-L142) behavior changes in emulator mode. For normal Azure, it uses the server-side `list_with_offset` path. But when `is_emulator` is enabled, it falls back to `list(prefix)` plus client-side filtering because Azurite does not support the `startFrom` query parameter. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
