hengfeiyang commented on code in PR #7595:
URL: https://github.com/apache/arrow-datafusion/pull/7595#discussion_r1329975067
##########
docs/source/user-guide/configs.md:
##########
@@ -76,6 +76,7 @@ Environment variables are read during `SessionConfig`
initialisation so they mus
| datafusion.execution.planning_concurrency | 0
| Fan-out during initial physical planning. This is mostly use to
plan `UNION` children in parallel. Defaults to the number of CPU cores on the
system
|
| datafusion.execution.sort_spill_reservation_bytes | 10485760
| Specifies the reserved memory for each spillable sort operation to
facilitate an in-memory merge. When a sort operation spills to disk, the
in-memory data must be sorted and merged before being written to a file. This
setting reserves a specific amount of memory for that in-memory sort/merge
process. Note: This setting is irrelevant if the sort operation cannot spill
(i.e., if there's no `DiskManager` configured).
|
| datafusion.execution.sort_in_place_threshold_bytes | 1048576
| When sorting, below what size should data be concatenated and
sorted in a single RecordBatch rather than sorted in batches and merged.
|
+| datafusion.execution.meta_fetch_concurrency | 0
| Number of files to read in parallel when inferring schema and
statistics Defaults to the number of CPU cores on the system
|
Review Comment:
Yes, the default is `cpu::num()`, so it has no fixed value.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
