GitHub user tustvold edited a comment on the discussion: Azure Storage Gen2 (hierarchical namespaces) - use DFS endpoint to improve performance
In general object_store intentionally tries to abstract away the notion of directories as not only are they a portability headache, as many stores don't support them, the vast majority of workloads actively don't want to care about them - instead delegating catalog responsibilities to something better suited to this, e.g. an RDBMS, Deltalake, iceberg, etc... I'm therefore not sure how useful this would be. > recursive directory listings Why would it provide better performance in this case? GitHub link: https://github.com/apache/arrow-rs-object-store/discussions/481#discussioncomment-14509296 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
