fsaintjacques opened a new pull request #7073:
URL: https://github.com/apache/arrow/pull/7073
* Simplified FileSystemDataset to hold a FragmentVector. Each
Fragment must be a FileFragment and is checked at
`FileSystemDataset::Make`. Fragments are not required to use the same
backing filesystem nor the same format.
* Removed `FileSystemDataset::format` and
`FileSystemDataset::partitions`.
* Since FileInfo is not required by neither FileSystemDataset and
FileSystemDatasetFactory, it is no possible to create a dataset
without any IO involved.
* Re-introduced the natural behavior of creating FileFragment with their
full partition expressions instead of removing the ancestors common
partitions.
* Added `Expression::IsSatisfiableWith` method.
* Added missing compression cmake options to archery.
* Ensure FileSource holds a shared_ptr<FileSystem> pointer.
This is required to refactor FileSystemDataset to support Buffer
FileSource and heterogeneous FileSystems.
* Rename `type` to `id`, following other classes.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
