[
https://issues.apache.org/jira/browse/ARROW-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17062119#comment-17062119
]
Wes McKinney commented on ARROW-8152:
-------------------------------------
What do you think about introducing the read parallelism as an option in
https://github.com/apache/arrow/blob/master/cpp/src/arrow/io/caching.h
? It might make sense to introduce an options struct so we can't cramming a
bunch of parameters into the {{Cache}} method here
> [C++] IO: split large coalesced reads into smaller ones
> -------------------------------------------------------
>
> Key: ARROW-8152
> URL: https://issues.apache.org/jira/browse/ARROW-8152
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: David Li
> Priority: Major
>
> We have a facility to coalesce small reads, but remote filesystems may also
> benefit from splitting large reads to take advantage of concurrency.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)