[ https://issues.apache.org/jira/browse/ARROW-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joris Van den Bossche reassigned ARROW-8283: -------------------------------------------- Assignee: Joris Van den Bossche > [Python][Dataset] Non-existent files are silently dropped in > pa.dataset.FileSystemDataset > ----------------------------------------------------------------------------------------- > > Key: ARROW-8283 > URL: https://issues.apache.org/jira/browse/ARROW-8283 > Project: Apache Arrow > Issue Type: Improvement > Components: Python > Reporter: Uwe Korn > Assignee: Joris Van den Bossche > Priority: Critical > Labels: dataset > Fix For: 1.0.0 > > > When passing a list of files to the constructor of > {{pyarrow.dataset.FileSystemDataset}}, all files that don't exist are > silently dropped immediately (i.e. no fragments are created for them). > Instead, I would expect that fragments will be created for them but an error > is thrown when one tries to read the fragment with the non-existent file. -- This message was sent by Atlassian Jira (v8.3.4#803005)