mingmwang commented on issue #1848: URL: https://github.com/apache/arrow-datafusion/issues/1848#issuecomment-1043804661
Beside the target partition count, I think there are couple of other configuration options that could be specified by the users and can be changed dynamically, for example, batch_size, parquet_pruning, repartition_windows etc. I searched the open issues and found there are couple of configuration related issues that are still open. [138](https://github.com/apache/arrow-datafusion/issues/138) [682](https://github.com/apache/arrow-datafusion/issues/682) I think it is time to resolve those and come up with a more extensible configuration design. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
