tustvold opened a new issue #1636: URL: https://github.com/apache/arrow-datafusion/issues/1636
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** https://github.com/apache/arrow-datafusion/pull/1526 added a MemoryManager along with the concept of a RuntimeEnv, this is awesome. Unfortunately `ExecutionContext::new()` and `ExecutionContext::with_config` call `RuntimeEnv::new()`, which in turn creates a new `MemoryManager` and `DiskManager`, which create a temporary directory and print logs. At least within IOx it is common to construct an `ExecutionContext` for each query, as various settings may change, most notably the catalog. Therefore these logs and especially the file IO are prohibitive **Describe the solution you'd like** I think it should be possible to pass an extant RuntimeEnv to an ExecutionContext, so that multiple different `ExecutionContext` can share the same resource pool. **Describe alternatives you've considered** We could maintain separate ExecutionContext for each type of query IOx executes, but this is just punting the problem imo. We want to be able to have queries running in different contexts, but on the same pool of resources managed by a `RuntimeEnv`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
