devinjdangelo commented on code in PR #8923:
URL: https://github.com/apache/arrow-datafusion/pull/8923#discussion_r1460472157
##########
datafusion/common/src/config.rs:
##########
@@ -408,7 +408,7 @@ config_namespace! {
/// parquet files by serializing them in parallel. Each column
/// in each row group in each output file are serialized in parallel
/// leveraging a maximum possible core count of
n_files*n_row_groups*n_columns.
- pub allow_single_file_parallelism: bool, default = false
+ pub allow_single_file_parallelism: bool, default = true
Review Comment:
We could choose to leave this feature disabled by default if we wish to
merge this before the next release. That would give us more time to ensure
there are no other issues and improve test coverage further.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
