Dandandan commented on pull request #706: URL: https://github.com/apache/arrow-datafusion/pull/706#issuecomment-877858042
> Maybe we do need two separate configs after all as per @Dandandan PR. Maybe with concurrency renamed to something more specific to readers. For now, something specific to readers seems fine to me. For the future, I think we also need to have something for setting the max number of threads for running multiple executors / DataFusion processes on one node (using the builder). By default this uses the number of CPU cores, but if you run multiple ballista workers on one node it should be better to lower this. https://docs.rs/tokio/1.8.1/tokio/runtime/struct.Builder.html# -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
