pitrou commented on a change in pull request #7688:
URL: https://github.com/apache/arrow/pull/7688#discussion_r452171864
##########
File path: python/pyarrow/fs.py
##########
@@ -63,6 +63,32 @@ def __getattr__(name):
)
+def _ensure_filesystem(filesystem):
+ if isinstance(filesystem, FileSystem):
+ return filesystem
+
+ # handle fsspec-compatible filesystems
+ try:
+ import fsspec
+ except ImportError:
+ pass
+ else:
+ if isinstance(filesystem, fsspec.AbstractFileSystem):
+ if type(filesystem).__name__ == 'LocalFileSystem':
+ # In case its a simple LocalFileSystem, use native arrow one
+ return LocalFileSystem()
+ return PyFileSystem(FSSpecHandler(filesystem))
+
+ # map old filesystems to new ones
+ from pyarrow.filesystem import LocalFileSystem as LegacyLocalFileSystem
+
+ if isinstance(filesystem, LegacyLocalFileSystem):
+ return LocalFileSystem()
+ # TODO handle HDFS?
Review comment:
Perhaps, but it's also not very important. Let's not bother about it
until there's a real need for it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
