Uwe Korn created ARROW-8283:
-------------------------------
Summary: [C++/Python][Dataset] Non-existent files are silently
dropped in pa.dataset.FileSystemDataset
Key: ARROW-8283
URL: https://issues.apache.org/jira/browse/ARROW-8283
Project: Apache Arrow
Issue Type: Improvement
Components: C++ - Dataset, Python
Reporter: Uwe Korn
When passing a list of files to the constructor of
{{pyarrow.dataset.FileSystemData}}, all files that don't exist are silently
dropped immediately (i.e. no fragments are created for them).
Instead, I would expect that fragments will be created for them but an error is
thrown when one tries to read the fragment with the non-existent file.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
