Kontinuation opened a new pull request, #687: URL: https://github.com/apache/sedona-db/pull/687
## Summary - Default `SedonaContextBuilder` memory limit to **75% of total physical memory** using a **fair memory pool**, replacing the previous unbounded/greedy defaults - Add `without_memory_limit()` builder method and `"unlimited"` option support to explicitly opt out of the memory limit - Align CLI defaults with the new builder defaults ## Changes ### `rust/sedona/src/context_builder.rs` - Add `sysinfo` dependency for querying system physical memory - `SedonaContextBuilder::new()` now defaults to `memory_limit = Some(75% of physical RAM)` and `pool_type = Fair` (was `None` and `Greedy`) - New `without_memory_limit()` builder method sets `memory_limit` to `None`, using DataFusion's unbounded pool - `from_options()` accepts `"unlimited"` (case-insensitive) for `memory_limit` key to disable the limit - Updated doc comments and examples to reflect the new behavior ### `sedona-cli/src/main.rs` - `--mem-pool-type` default changed from `Greedy` to `Fair` - `--memory-limit` now accepts `"unlimited"` to disable the limit - Updated help text ### Dependencies - Added `sysinfo = "0.38"` to workspace and `rust/sedona` crate ## Testing All 19 `context_builder` tests pass, including new tests for: - `test_without_memory_limit` - verifies the new builder method - `test_from_options_unlimited` - verifies `"unlimited"` / `"Unlimited"` / `"UNLIMITED"` handling - `test_build_runtime_env_default` - verifies default builder builds successfully - `test_build_context_without_memory_limit` - end-to-end test for unlimited path -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
