andygrove commented on issue #157:
URL:
https://github.com/apache/arrow-datafusion-python/issues/157#issuecomment-1411203031
We need to expose the memory/disk config in the Python bindings so that they
can be set when creating the SessionContext. Here is Rust code for reference.
I will try and look at this over the weekend unless someone beats me to it.
```rust
let runtime_config = crate::execution::runtime_env::RuntimeConfig::new()
.with_memory_pool(Arc::new(crate::execution::memory_pool::GreedyMemoryPool::new(1024*1024*1024)))
.with_disk_manager(crate::execution::disk_manager::DiskManagerConfig::new_specified(vec!["/Users/a/spill/".into()]));
let runtime =
Arc::new(crate::execution::runtime_env::RuntimeEnv::new(runtime_config).unwrap());
let ctx = SessionContext::with_config_rt(SessionConfig::new(),
runtime);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
