This is an automated email from the ASF dual-hosted git repository.
yjshen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git.
from 8b249ae Add db benchmark script (#1928)
add b88f103 Introduce StageManager for managing tasks stage by stage
(#1983)
No new revisions were added by this update.
Summary of changes:
ballista/rust/scheduler/Cargo.toml | 1 +
ballista/rust/scheduler/src/planner.rs | 20 +
.../src/scheduler_server/event.rs} | 26 +-
.../scheduler/src/scheduler_server/event_loop.rs | 30 +-
.../src/scheduler_server/external_scaler.rs | 10 +-
.../rust/scheduler/src/scheduler_server/grpc.rs | 242 +++---
.../rust/scheduler/src/scheduler_server/mod.rs | 370 ++++++++-
.../src/scheduler_server/query_stage_scheduler.rs | 465 +++++++++---
.../{in_memory_state.rs => executor_manager.rs} | 91 +--
ballista/rust/scheduler/src/state/mod.rs | 827 +--------------------
.../rust/scheduler/src/state/persistent_state.rs | 3 +-
ballista/rust/scheduler/src/state/stage_manager.rs | 782 +++++++++++++++++++
.../rust/scheduler/src/state/task_scheduler.rs | 160 ++--
13 files changed, 1824 insertions(+), 1203 deletions(-)
copy ballista/rust/{core/src/lib.rs =>
scheduler/src/scheduler_server/event.rs} (68%)
rename ballista/rust/scheduler/src/state/{in_memory_state.rs =>
executor_manager.rs} (68%)
create mode 100644 ballista/rust/scheduler/src/state/stage_manager.rs
