alamb commented on issue #928: URL: https://github.com/apache/arrow-datafusion/issues/928#issuecomment-903668640
If we go this approach, care must be taken to ensure any newly created executor does not interfere with one created with `[tokio::main]` Here is an example of such a dedicated tokio executor that we made in IOx: https://github.com/influxdata/influxdb_iox/blob/main/query/src/exec/task.rs#L48-L65 I would be willing to contribute the `DedicatedExecutor` code back upstream to DataFusion if there is interest -- and we could add a configuration setting for thread counts, etc. I think the `DedicatedExecutor` also satisfies the usecase of "running DataFusion CPU-bound tasks on a different thread pool than IO bound tasks" -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
