hengfeiyang commented on code in PR #7595:
URL: https://github.com/apache/arrow-datafusion/pull/7595#discussion_r1332382763
##########
datafusion/common/src/config.rs:
##########
@@ -251,6 +251,11 @@ config_namespace! {
/// and sorted in a single RecordBatch rather than sorted in
/// batches and merged.
pub sort_in_place_threshold_bytes: usize, default = 1024 * 1024
+
+ /// Number of files to read in parallel when inferring schema and
statistics
+ ///
+ /// Defaults to the number of CPU cores on the system
+ pub meta_fetch_concurrency: usize, default = num_cpus::get()
Review Comment:
i will change it to `32`. this should be better. let me do that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
