pitrou commented on a change in pull request #10132:
URL: https://github.com/apache/arrow/pull/10132#discussion_r621102561
##########
File path: cpp/src/arrow/csv/options.h
##########
@@ -119,15 +119,20 @@ struct ARROW_EXPORT ReadOptions {
/// Whether to use the global CPU thread pool
bool use_threads = true;
- /// Block size we request from the IO layer; also determines the size of
- /// chunks when use_threads is true
+
+ /// \brief Block size we request from the IO layer.
+ ///
+ /// This will determine multi-threading granularity as well as
Review comment:
The CSV reader processes each block separately, and therefore
potentially on a different thread. Additionally, each column in each block is
converted separately as well.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
