Joris Van den Bossche created ARROW-16460:
---------------------------------------------
Summary: [Python] Some dataset tests using PyFileSystem are
failing on Windows
Key: ARROW-16460
URL: https://issues.apache.org/jira/browse/ARROW-16460
Project: Apache Arrow
Issue Type: Test
Components: Python
Reporter: Joris Van den Bossche
We have some dataset tests that are skipped on Windows, because they are
failing with FileNotFound errors.
*
https://github.com/apache/arrow/blob/3c3e68c194ca6ac07086ddc1bb44fe153970213e/python/pyarrow/tests/test_dataset.py#L3261-L3264
*https://github.com/apache/arrow/blob/893faa741f34ee450070503566dafb7291e24d9f/python/pyarrow/tests/test_dataset.py#L3124-L3145
(and see https://github.com/apache/arrow/pull/13033#issuecomment-1116180259
for some analysis)
In the second case, it seems that for some reason, the file paths of the
fragments are relative paths to the root of the dataset (while locally for me
this gives absolute paths).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
