JoshADHD opened a new issue #7857:
URL: https://github.com/apache/arrow/issues/7857
When attempting to source parquet files for a dataset, I've found that
underscores at the beginning of directory names (which I use often for OCD
purposes) cause the function to not find any files.
Examples:
`dataset <- open_dataset(
sources = "/data/_split_data",
partitioning = hive_partition(year = int32(), month = string())
)
dataset <- open_dataset(
sources = "/_data/split_data",
partitioning = hive_partition(year = int32(), month = string())
)`
Both of these return `FileSystemDataset with 0 Parquet files` when queried
via console. If I remove underscores from the beginning of directory names, the
function returns as expected.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
