wjones127 commented on issue #2445:
URL:
https://github.com/apache/arrow-datafusion/issues/2445#issuecomment-1119699907
Also relevant:
* #2246
* #2185
As part of that PR, I plan on creating a generic suite of tests to validate
a `ObjectStore` implementation, and that could enforce these behavior
expectations for each implementation.
For FileSystem vs ObjectStore, I'm only familiar with implementations of the
first in the context of query engines (such as [Arrow C++'s
FileSystem](https://github.com/apache/arrow/blob/master/cpp/src/arrow/filesystem/filesystem.h)
or Python's [fsspec](https://filesystem-spec.readthedocs.io/en/latest/)). Are
there examples of ObjectStore implementations?
My preference is for a "FileSystem" approach since that's more familiar, but
open the ObjectStore approach as long as that can be used to read and write in
a way compatible with other systems that may use a FileSystem approach.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
