This is an automated email from the ASF dual-hosted git repository.
dheres pushed a change to branch only_decode_once
in repository https://gitbox.apache.org/repos/asf/arrow-ballista.git
from 882a9d58 WIP
add 565088f4 Make task launcher pub (#695)
add fe6e2f59 Make task_manager pub (#698)
add 85031c42 Add ExecutionEngine abstraction (#687)
add da77fad2 Allow accessing s3 locations in client mode (#700)
add a7dfcb39 deployment/docker-compose.md incorrect remote ref (#699)
add 9206bdb2 Fix for error message during testing (#707)
add 8007a414 Upgrade datafusion to 20.0.0 & sqlparser to to 0.32.0 (#711)
add 620b5cf3 Update README.md (#729)
add f98a3785 Update link to proto file in dev docs (#713)
add a08347a3 Fix `show tables` fails (#715)
add 0b496e59 Remove redundant fields in ExecutorManager (#728)
add 837c8406 Fix parameter '--config-backend' to '--cluster-backend' (#720)
add 32f97930 Upgrade DataFusion to 21.0.0 (#727)
add 48c4c2d9 [minor] remove useless bracelet (#739)
add da7614fd Merge branch 'main' into only_decode_once
No new revisions were added by this update.
Summary of changes:
.github/workflows/rust.yml | 46 ++-
Cargo.toml | 29 +-
ballista-cli/Cargo.toml | 16 +-
ballista/client/Cargo.toml | 6 +-
ballista/client/README.md | 2 +-
ballista/client/src/context.rs | 16 +-
ballista/core/Cargo.toml | 9 +-
.../core/src/execution_plans/shuffle_reader.rs | 1 -
ballista/core/src/utils.rs | 85 +++--
ballista/executor/Cargo.toml | 10 +-
ballista/executor/src/bin/main.rs | 1 +
ballista/executor/src/execution_engine.rs | 114 +++++++
ballista/executor/src/execution_loop.rs | 26 +-
ballista/executor/src/executor.rs | 74 ++--
ballista/executor/src/executor_process.rs | 5 +
ballista/executor/src/executor_server.rs | 30 +-
ballista/executor/src/lib.rs | 1 +
ballista/executor/src/metrics/mod.rs | 14 +-
ballista/executor/src/standalone.rs | 1 +
ballista/scheduler/Cargo.toml | 8 +-
ballista/scheduler/scheduler_config_spec.toml | 8 +-
ballista/scheduler/src/bin/main.rs | 2 +-
ballista/scheduler/src/cluster/event/mod.rs | 6 +-
ballista/scheduler/src/cluster/kv.rs | 199 +++++++----
ballista/scheduler/src/cluster/memory.rs | 75 ++---
ballista/scheduler/src/cluster/mod.rs | 27 +-
ballista/scheduler/src/cluster/test/mod.rs | 36 +-
ballista/scheduler/src/config.rs | 34 +-
ballista/scheduler/src/planner.rs | 43 +--
ballista/scheduler/src/scheduler_server/grpc.rs | 45 +--
ballista/scheduler/src/scheduler_server/mod.rs | 6 +-
.../src/scheduler_server/query_stage_scheduler.rs | 8 +-
ballista/scheduler/src/state/execution_graph.rs | 280 ++++++++--------
.../src/state/execution_graph/execution_stage.rs | 33 +-
.../scheduler/src/state/execution_graph_dot.rs | 92 +++--
ballista/scheduler/src/state/executor_manager.rs | 363 ++++----------------
ballista/scheduler/src/state/mod.rs | 7 +-
ballista/scheduler/src/state/task_manager.rs | 20 +-
ballista/scheduler/src/test_utils.rs | 6 +-
ballista/scheduler/ui/README.md | 6 +-
benchmarks/Cargo.toml | 5 +-
benchmarks/src/bin/tpch.rs | 372 ++++++++++-----------
docker-compose.yml | 2 +-
docs/developer/architecture.md | 2 +-
.../source/user-guide/deployment/docker-compose.md | 2 +-
examples/Cargo.toml | 2 +-
46 files changed, 1072 insertions(+), 1103 deletions(-)
create mode 100644 ballista/executor/src/execution_engine.rs
