roeap commented on issue #3283: URL: https://github.com/apache/arrow-rs/issues/3283#issuecomment-1341107873
The object_store crate should support Gen2 accounts as is. AFAIK, gen2 accounts always also expose the blob APIs, which are "almost" the same, mostly the behavior @tustvold pointed to needs to be handled to be consistent with other stores. To get it to work, just pass in a "blob style" url pointing at the same account / container as the gen2 url. W.r.t the issue linked above, we have an implementation of a more [generic url parser](https://github.com/delta-io/delta-rs/blob/9aaef826ea2704597998925f03bfba052cd84df1/rust/src/builder/mod.rs#L483-L592), mainly intented to resolve most well known url formats for storage locations. My hope was to move this upstream behind the object store factory API currently part of datafusion. @tustvold, do you think the logic in the link above is "close enough" that we could start iterating in a PR here? If so, I'm happy to propse one. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
