pitrou commented on code in PR #13796:
URL: https://github.com/apache/arrow/pull/13796#discussion_r939501843
##########
cpp/src/arrow/filesystem/filesystem.h:
##########
@@ -132,6 +133,9 @@ struct ARROW_EXPORT FileSelector {
bool recursive;
/// The maximum number of subdirectories to recurse into.
int32_t max_recursion;
+ /// How many partitions should be processed in parallel. May not be
supported by all
+ /// implementations of `GetFileSystemGenerator`.
+ util::optional<int32_t> partitions_readahead;
Review Comment:
However, I also don't understand why this is an attribute of `FileSelector`.
This sounds more like an implementation-specific know that should probably be
in `LocalFileSystemOptions`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
