jorisvandenbossche commented on code in PR #13033:
URL: https://github.com/apache/arrow/pull/13033#discussion_r863710252
##########
python/pyarrow/tests/test_dataset.py:
##########
@@ -2582,6 +2600,38 @@ def test_open_dataset_from_fsspec(tempdir):
assert dataset.schema.equals(table.schema)
[email protected]
[email protected]
+def test_file_format_inspect_fsspec(s3_filesystem):
+ # https://issues.apache.org/jira/browse/ARROW-16413
Review Comment:
So it does work (I checked the test hangs with a local fs as well, before
applying the fix), with the caveat that I need to manually construct the
PyFileSystem with FSSpecHandler, because if you pass an actual fsspec local
filesystem, we internally convert it into a arrow native local filesystem:
https://github.com/apache/arrow/blob/7a0f00c16e084d194ae53d209b33b809cfc8f2d5/python/pyarrow/fs.py#L109-L113
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
