GitHub user tustvold added a comment to the discussion: Azure Storage Gen2 (hierarchical namespaces) - use DFS endpoint to improve performance
> Because the DFS endpoint exposes a filesystem-like API that supports > recursive listing in one call. The Blob endpoint is object-store oriented: it > only lists a flat set of objects under a given prefix. To traverse a > hierarchy recursively with the Blob API, the client must repeatedly enumerate > each "folder level" and stitch results together. That means many network > round-trips and higher latency. This isn't the case, if you don't specify a delimiter it lists recursively GitHub link: https://github.com/apache/arrow-rs-object-store/discussions/481#discussioncomment-14591923 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
