GitHub user tustvold edited a comment on the discussion: Azure Storage Gen2 (hierarchical namespaces) - use DFS endpoint to improve performance
> Because the DFS endpoint exposes a filesystem-like API that supports > recursive listing in one call. The Blob endpoint is object-store oriented: it > only lists a flat set of objects under a given prefix. To traverse a > hierarchy recursively with the Blob API, the client must repeatedly enumerate > each "folder level" and stitch results together. That means many network > round-trips and higher latency. This isn't the case, if you don't specify a delimiter it lists recursively See https://learn.microsoft.com/en-us/rest/api/storageservices/list-blobs?tabs=microsoft-entra-id GitHub link: https://github.com/apache/arrow-rs-object-store/discussions/481#discussioncomment-14591923 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
