This is an automated email from the ASF dual-hosted git repository.
paleolimbot pushed a change to branch branch-0.3.0
in repository https://gitbox.apache.org/repos/asf/sedona-db.git
from a7bcf6ac Update R version
new 5e899557 feat(rust/sedona): Auto-configure spilled batch in-memory
size threshold based on global memory limit (#680)
new 8122e70b fix(rust/sedona-testing): serialize env-mutating tests with a
mutex to prevent race conditions (#685)
new 31adbe10 docs: add memory management and spill configuration guide
(#679)
new 7a3ab1c2 fix(rust/sedona-spatial-join): wrap probe-side repartition in
ProbeShuffleExec to prevent optimizer stripping (#677)
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/memory-management.ipynb | 384 +++++++++++++++++++++
docs/memory-management.md | 240 +++++++++++++
mkdocs.yml | 2 +
rust/sedona-spatial-join/src/lib.rs | 4 +
rust/sedona-spatial-join/src/planner.rs | 1 +
.../src/planner/physical_planner.rs | 10 +-
.../src/planner/probe_shuffle_exec.rs | 225 ++++++++++++
.../tests/spatial_join_integration.rs | 37 +-
rust/sedona-testing/src/data.rs | 10 +
rust/sedona/src/context.rs | 48 ++-
10 files changed, 950 insertions(+), 11 deletions(-)
create mode 100644 docs/memory-management.ipynb
create mode 100644 docs/memory-management.md
create mode 100644 rust/sedona-spatial-join/src/planner/probe_shuffle_exec.rs
