alamb commented on code in PR #8923:
URL: https://github.com/apache/arrow-datafusion/pull/8923#discussion_r1460905819
##########
datafusion/common/src/config.rs:
##########
@@ -408,7 +408,7 @@ config_namespace! {
/// parquet files by serializing them in parallel. Each column
/// in each row group in each output file are serialized in parallel
/// leveraging a maximum possible core count of
n_files*n_row_groups*n_columns.
- pub allow_single_file_parallelism: bool, default = false
+ pub allow_single_file_parallelism: bool, default = true
Review Comment:
We are about to release 35.0.0 which would not include this change. See
voting thread here:
https://lists.apache.org/thread/onbs8l0w5s7693fchpyvwwgh61gf1jf8
Thus I think it would actually be best to turn this default to true so the
code gets maximum "bake time" from people working off `main` before a release
==> This PR looks good to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
