This is an automated email from the ASF dual-hosted git repository.
martin-g pushed a change to branch redirect-root-to-nightlies
in repository https://gitbox.apache.org/repos/asf/datafusion-ballista.git
omit f7f6bd943 Re-enable the CI condition for deployment at nightlies.a.o
omit 379ca1886 Update python/Cargo.lock
omit 312012306 Own the parsed query parameter values
omit 296e2195c Import std::collections::HashMap
omit b38c47f7b Use "See Other" redirect (code 303)
omit 9901e190f URL encode the query parameters
omit 023d60366 Re-enable the CI job condition to deploy WebTUI only on push
to main
omit 30cee7040 Fix rsync delete command: `--delete does not work without
--recursive or --dirs`
omit 91728c589 feat(scheduler): Redirect '/' to nighlies.a.o WebTUI
add bcd9b56ce chore(ci): Add a CI workflow that checks that the used CI
actions and their versions are allowed (#2058)
add 1c25d30d7 refactor(tui): Drop the header banner/logo (#2057)
add e843c8e86 Add TPC-DS correctness testing (#2048)
add 173e28f6a fix: spill sort shuffle writer when the memory pool rejects
a reservation grow (#2061)
add 66af2392a fix: enable the executor client pool by default (#2069)
add f3fc9d0ca Rename `task_slots` -> `vcores` (executor spec + CLI) (#2045)
add 449e7b5ef fix: map a task's partition through UnionExec when
restricting file scans (#2070)
add 0f6ec8c6c fix: keep EmptyExec partition count intact across stage
serialization (#2062)
add 26b293918 fix: remove the static planner SortMergeJoinExec broadcast
conversion (#2072)
add bce81902f docs: add benchmarking page to the contributors guide (#2075)
add c4260b828 ci: skip expensive workflows for docs-only changes (#2073)
add 992c42b06 chore(deps): bump tokio from 1.52.3 to 1.52.4 (#2080)
add 6d517b4a4 chore(deps): bump tokio from 1.52.3 to 1.52.4 in /python
(#2079)
add 160bb3326 chore(deps): bump taiki-e/install-action from 2.83.2 to
2.83.3 (#2076)
add fcf2d92c4 chore(deps): bump github/codeql-action/init from 4.37.0 to
4.37.1 (#2078)
add f68f13801 feat(scheduler): Redirect '/' to nighlies.a.o WebTUI
add 467b4e5a8 Fix rsync delete command: `--delete does not work without
--recursive or --dirs`
add a9f4b9fa7 Re-enable the CI job condition to deploy WebTUI only on push
to main
add e5dabccca URL encode the query parameters
add d99f33fa4 Use "See Other" redirect (code 303)
add b0d905631 Import std::collections::HashMap
add a7900b468 Own the parsed query parameter values
add fce4b6390 Update python/Cargo.lock
add 1c81a45fa Re-enable the CI condition for deployment at nightlies.a.o
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f7f6bd943)
\
N -- N -- N refs/heads/redirect-root-to-nightlies (1c81a45fa)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/dependabot.yml | 28 +-
.../workflows/allowlist-check.yml | 27 +-
.github/workflows/build.yml | 12 +-
.github/workflows/codeql.yml | 4 +-
.github/workflows/dependencies.yml | 4 +-
.github/workflows/docker.yml | 8 +-
.github/workflows/rust.yml | 28 +-
.github/workflows/{tpch.yml => tpcds.yml} | 84 +++--
.github/workflows/tpch.yml | 12 +-
.github/workflows/web-tui.yml | 10 +-
Cargo.lock | 100 +-----
README.md | 2 +-
ballista-cli/Cargo.toml | 3 +-
ballista-cli/README.md | 4 +-
ballista-cli/Trunk.toml | 9 -
ballista-cli/ballista-web-tui.html | 14 -
ballista-cli/src/main.rs | 31 +-
ballista-cli/src/tui/app.rs | 6 +-
ballista-cli/src/tui/domain/executors.rs | 36 +-
ballista-cli/src/tui/infrastructure/theme.rs | 57 ++--
ballista-cli/src/tui/ui/header/ballista-logo.svg | 29 --
ballista-cli/src/tui/ui/header/mod.rs | 52 +--
ballista-cli/src/tui/ui/header/scheduler_state.rs | 2 +-
.../src/tui/ui/main/executors/executors_table.rs | 12 +-
ballista/client/src/extension.rs | 6 +-
ballista/client/tests/context_checks.rs | 8 -
ballista/core/proto/ballista.proto | 22 +-
ballista/core/src/config.rs | 27 +-
.../core/src/execution_plans/shuffle_reader.rs | 15 +-
.../src/execution_plans/sort_shuffle/writer.rs | 88 +++--
ballista/core/src/serde/generated/ballista.rs | 20 +-
ballista/core/src/serde/mod.rs | 39 +++
ballista/core/src/serde/scheduler/from_proto.rs | 26 +-
ballista/core/src/serde/scheduler/mod.rs | 71 +++-
ballista/core/src/serde/scheduler/to_proto.rs | 18 +-
ballista/executor/src/config.rs | 60 +++-
ballista/executor/src/execution_engine.rs | 141 +++++++-
ballista/executor/src/execution_loop.rs | 18 +-
ballista/executor/src/executor.rs | 16 +-
ballista/executor/src/executor_process.rs | 66 ++--
ballista/executor/src/executor_server.rs | 8 +-
ballista/executor/src/standalone.rs | 14 +-
ballista/scheduler/src/cluster/memory.rs | 40 +--
ballista/scheduler/src/cluster/mod.rs | 125 ++++---
ballista/scheduler/src/config.rs | 4 +-
ballista/scheduler/src/planner.rs | 243 ++++++--------
ballista/scheduler/src/scheduler_server/grpc.rs | 52 ++-
ballista/scheduler/src/scheduler_server/mod.rs | 31 +-
.../scheduler/src/state/aqe/test/alter_stages.rs | 10 +-
.../scheduler/src/state/aqe/test/coalesce_rule.rs | 2 +-
ballista/scheduler/src/state/aqe/test/mod.rs | 4 +-
ballista/scheduler/src/state/executor_manager.rs | 14 +-
ballista/scheduler/src/test_utils.rs | 20 +-
.../tests/tpch_plan_stability/approved/q10.txt | 47 ++-
.../tests/tpch_plan_stability/approved/q11.txt | 74 ++---
.../tests/tpch_plan_stability/approved/q15.txt | 64 ++--
.../tests/tpch_plan_stability/approved/q16.txt | 42 ++-
.../tests/tpch_plan_stability/approved/q2.txt | 140 ++++----
.../tests/tpch_plan_stability/approved/q20.txt | 49 ++-
.../tests/tpch_plan_stability/approved/q21.txt | 61 ++--
.../tests/tpch_plan_stability/approved/q5.txt | 80 +++--
.../tests/tpch_plan_stability/approved/q7.txt | 73 ++--
.../tests/tpch_plan_stability/approved/q8.txt | 104 +++---
.../tests/tpch_plan_stability/approved/q9.txt | 63 ++--
benchmarks/.gitignore | 3 +-
benchmarks/README.md | 80 +++++
benchmarks/queries-tpcds/q1.sql | 26 ++
benchmarks/queries-tpcds/q10.sql | 60 ++++
benchmarks/queries-tpcds/q11.sql | 82 +++++
benchmarks/queries-tpcds/q12.sql | 35 ++
benchmarks/queries-tpcds/q13.sql | 53 +++
benchmarks/queries-tpcds/q14.sql | 211 ++++++++++++
benchmarks/queries-tpcds/q15.sql | 21 ++
benchmarks/queries-tpcds/q16.sql | 32 ++
benchmarks/queries-tpcds/q17.sql | 46 +++
benchmarks/queries-tpcds/q18.sql | 35 ++
benchmarks/queries-tpcds/q19.sql | 26 ++
benchmarks/queries-tpcds/q2.sql | 61 ++++
benchmarks/queries-tpcds/q20.sql | 31 ++
benchmarks/queries-tpcds/q21.sql | 31 ++
benchmarks/queries-tpcds/q22.sql | 21 ++
benchmarks/queries-tpcds/q23.sql | 108 ++++++
benchmarks/queries-tpcds/q24.sql | 108 ++++++
benchmarks/queries-tpcds/q25.sql | 49 +++
benchmarks/queries-tpcds/q26.sql | 22 ++
benchmarks/queries-tpcds/q27.sql | 24 ++
benchmarks/queries-tpcds/q28.sql | 54 +++
benchmarks/queries-tpcds/q29.sql | 48 +++
benchmarks/queries-tpcds/q3.sql | 22 ++
benchmarks/queries-tpcds/q30.sql | 31 ++
benchmarks/queries-tpcds/q31.sql | 53 +++
benchmarks/queries-tpcds/q32.sql | 29 ++
benchmarks/queries-tpcds/q33.sql | 76 +++++
benchmarks/queries-tpcds/q34.sql | 32 ++
benchmarks/queries-tpcds/q35.sql | 59 ++++
benchmarks/queries-tpcds/q36.sql | 31 ++
benchmarks/queries-tpcds/q37.sql | 18 +
benchmarks/queries-tpcds/q38.sql | 24 ++
benchmarks/queries-tpcds/q39.sql | 55 +++
benchmarks/queries-tpcds/q4.sql | 117 +++++++
benchmarks/queries-tpcds/q40.sql | 29 ++
benchmarks/queries-tpcds/q41.sql | 53 +++
benchmarks/queries-tpcds/q42.sql | 23 ++
benchmarks/queries-tpcds/q43.sql | 20 ++
benchmarks/queries-tpcds/q44.sql | 36 ++
benchmarks/queries-tpcds/q45.sql | 21 ++
benchmarks/queries-tpcds/q46.sql | 36 ++
benchmarks/queries-tpcds/q47.sql | 52 +++
benchmarks/queries-tpcds/q48.sql | 68 ++++
benchmarks/queries-tpcds/q49.sql | 130 ++++++++
benchmarks/queries-tpcds/q5.sql | 129 ++++++++
benchmarks/queries-tpcds/q50.sql | 60 ++++
benchmarks/queries-tpcds/q51.sql | 46 +++
benchmarks/queries-tpcds/q52.sql | 23 ++
benchmarks/queries-tpcds/q53.sql | 29 ++
benchmarks/queries-tpcds/q54.sql | 57 ++++
benchmarks/queries-tpcds/q55.sql | 15 +
benchmarks/queries-tpcds/q56.sql | 70 ++++
benchmarks/queries-tpcds/q57.sql | 49 +++
benchmarks/queries-tpcds/q58.sql | 66 ++++
benchmarks/queries-tpcds/q59.sql | 45 +++
benchmarks/queries-tpcds/q6.sql | 27 ++
benchmarks/queries-tpcds/q60.sql | 79 +++++
benchmarks/queries-tpcds/q61.sql | 45 +++
benchmarks/queries-tpcds/q62.sql | 36 ++
benchmarks/queries-tpcds/q63.sql | 30 ++
benchmarks/queries-tpcds/q64.sql | 122 +++++++
benchmarks/queries-tpcds/q65.sql | 30 ++
benchmarks/queries-tpcds/q66.sql | 221 +++++++++++++
benchmarks/queries-tpcds/q67.sql | 45 +++
benchmarks/queries-tpcds/q68.sql | 43 +++
benchmarks/queries-tpcds/q69.sql | 48 +++
benchmarks/queries-tpcds/q7.sql | 22 ++
benchmarks/queries-tpcds/q70.sql | 39 +++
benchmarks/queries-tpcds/q71.sql | 41 +++
benchmarks/queries-tpcds/q72.sql | 30 ++
benchmarks/queries-tpcds/q73.sql | 29 ++
benchmarks/queries-tpcds/q74.sql | 62 ++++
benchmarks/queries-tpcds/q75.sql | 71 ++++
benchmarks/queries-tpcds/q76.sql | 25 ++
benchmarks/queries-tpcds/q77.sql | 109 ++++++
benchmarks/queries-tpcds/q78.sql | 59 ++++
benchmarks/queries-tpcds/q79.sql | 24 ++
benchmarks/queries-tpcds/q8.sql | 109 ++++++
benchmarks/queries-tpcds/q80.sql | 97 ++++++
benchmarks/queries-tpcds/q81.sql | 32 ++
benchmarks/queries-tpcds/q82.sql | 18 +
benchmarks/queries-tpcds/q83.sql | 68 ++++
benchmarks/queries-tpcds/q84.sql | 22 ++
benchmarks/queries-tpcds/q85.sql | 85 +++++
benchmarks/queries-tpcds/q86.sql | 27 ++
benchmarks/queries-tpcds/q87.sql | 24 ++
benchmarks/queries-tpcds/q88.sql | 95 ++++++
benchmarks/queries-tpcds/q89.sql | 29 ++
benchmarks/queries-tpcds/q9.sql | 52 +++
benchmarks/queries-tpcds/q90.sql | 23 ++
benchmarks/queries-tpcds/q91.sql | 32 ++
benchmarks/queries-tpcds/q92.sql | 31 ++
benchmarks/queries-tpcds/q93.sql | 19 ++
benchmarks/queries-tpcds/q94.sql | 30 ++
benchmarks/queries-tpcds/q95.sql | 33 ++
benchmarks/queries-tpcds/q96.sql | 17 +
benchmarks/queries-tpcds/q97.sql | 26 ++
benchmarks/queries-tpcds/q98.sql | 34 ++
benchmarks/queries-tpcds/q99.sql | 36 ++
benchmarks/src/bin/shuffle_bench.rs | 16 +-
benchmarks/src/bin/tpcds.rs | 341 +++++++++++++++++++
benchmarks/src/bin/tpch.rs | 317 +-----------------
benchmarks/src/lib.rs | 368 +++++++++++++++++++++
benchmarks/{tpch-gen.sh => tpcds-gen.sh} | 30 +-
...alone-entrypoint.sh => vendor-tpcds-queries.sh} | 23 +-
docker-compose.yml | 2 +-
docs/source/contributors-guide/benchmarking.md | 351 ++++++++++++++++++++
docs/source/index.rst | 1 +
docs/source/upgrading/54.0.0.md | 4 -
docs/source/upgrading/55.0.0.md | 73 ++++
docs/source/upgrading/index.rst | 1 +
docs/source/user-guide/cli.md | 2 +-
docs/source/user-guide/deployment/docker.md | 2 +-
docs/source/user-guide/python/quickstart.md | 6 +-
docs/source/user-guide/tuning-guide.md | 16 +-
examples/examples/mtls-cluster.rs | 4 +-
examples/examples/standalone-substrait.rs | 6 +-
python/Cargo.lock | 4 +-
python/src/cluster.rs | 12 +-
185 files changed, 7546 insertions(+), 1659 deletions(-)
copy dev/docker/executor-entrypoint.sh =>
.github/workflows/allowlist-check.yml (60%)
mode change 100755 => 100644
copy .github/workflows/{tpch.yml => tpcds.yml} (70%)
delete mode 100644 ballista-cli/src/tui/ui/header/ballista-logo.svg
create mode 100644 benchmarks/queries-tpcds/q1.sql
create mode 100644 benchmarks/queries-tpcds/q10.sql
create mode 100644 benchmarks/queries-tpcds/q11.sql
create mode 100644 benchmarks/queries-tpcds/q12.sql
create mode 100644 benchmarks/queries-tpcds/q13.sql
create mode 100644 benchmarks/queries-tpcds/q14.sql
create mode 100644 benchmarks/queries-tpcds/q15.sql
create mode 100644 benchmarks/queries-tpcds/q16.sql
create mode 100644 benchmarks/queries-tpcds/q17.sql
create mode 100644 benchmarks/queries-tpcds/q18.sql
create mode 100644 benchmarks/queries-tpcds/q19.sql
create mode 100644 benchmarks/queries-tpcds/q2.sql
create mode 100644 benchmarks/queries-tpcds/q20.sql
create mode 100644 benchmarks/queries-tpcds/q21.sql
create mode 100644 benchmarks/queries-tpcds/q22.sql
create mode 100644 benchmarks/queries-tpcds/q23.sql
create mode 100644 benchmarks/queries-tpcds/q24.sql
create mode 100644 benchmarks/queries-tpcds/q25.sql
create mode 100644 benchmarks/queries-tpcds/q26.sql
create mode 100644 benchmarks/queries-tpcds/q27.sql
create mode 100644 benchmarks/queries-tpcds/q28.sql
create mode 100644 benchmarks/queries-tpcds/q29.sql
create mode 100644 benchmarks/queries-tpcds/q3.sql
create mode 100644 benchmarks/queries-tpcds/q30.sql
create mode 100644 benchmarks/queries-tpcds/q31.sql
create mode 100644 benchmarks/queries-tpcds/q32.sql
create mode 100644 benchmarks/queries-tpcds/q33.sql
create mode 100644 benchmarks/queries-tpcds/q34.sql
create mode 100644 benchmarks/queries-tpcds/q35.sql
create mode 100644 benchmarks/queries-tpcds/q36.sql
create mode 100644 benchmarks/queries-tpcds/q37.sql
create mode 100644 benchmarks/queries-tpcds/q38.sql
create mode 100644 benchmarks/queries-tpcds/q39.sql
create mode 100644 benchmarks/queries-tpcds/q4.sql
create mode 100644 benchmarks/queries-tpcds/q40.sql
create mode 100644 benchmarks/queries-tpcds/q41.sql
create mode 100644 benchmarks/queries-tpcds/q42.sql
create mode 100644 benchmarks/queries-tpcds/q43.sql
create mode 100644 benchmarks/queries-tpcds/q44.sql
create mode 100644 benchmarks/queries-tpcds/q45.sql
create mode 100644 benchmarks/queries-tpcds/q46.sql
create mode 100644 benchmarks/queries-tpcds/q47.sql
create mode 100644 benchmarks/queries-tpcds/q48.sql
create mode 100644 benchmarks/queries-tpcds/q49.sql
create mode 100644 benchmarks/queries-tpcds/q5.sql
create mode 100644 benchmarks/queries-tpcds/q50.sql
create mode 100644 benchmarks/queries-tpcds/q51.sql
create mode 100644 benchmarks/queries-tpcds/q52.sql
create mode 100644 benchmarks/queries-tpcds/q53.sql
create mode 100644 benchmarks/queries-tpcds/q54.sql
create mode 100644 benchmarks/queries-tpcds/q55.sql
create mode 100644 benchmarks/queries-tpcds/q56.sql
create mode 100644 benchmarks/queries-tpcds/q57.sql
create mode 100644 benchmarks/queries-tpcds/q58.sql
create mode 100644 benchmarks/queries-tpcds/q59.sql
create mode 100644 benchmarks/queries-tpcds/q6.sql
create mode 100644 benchmarks/queries-tpcds/q60.sql
create mode 100644 benchmarks/queries-tpcds/q61.sql
create mode 100644 benchmarks/queries-tpcds/q62.sql
create mode 100644 benchmarks/queries-tpcds/q63.sql
create mode 100644 benchmarks/queries-tpcds/q64.sql
create mode 100644 benchmarks/queries-tpcds/q65.sql
create mode 100644 benchmarks/queries-tpcds/q66.sql
create mode 100644 benchmarks/queries-tpcds/q67.sql
create mode 100644 benchmarks/queries-tpcds/q68.sql
create mode 100644 benchmarks/queries-tpcds/q69.sql
create mode 100644 benchmarks/queries-tpcds/q7.sql
create mode 100644 benchmarks/queries-tpcds/q70.sql
create mode 100644 benchmarks/queries-tpcds/q71.sql
create mode 100644 benchmarks/queries-tpcds/q72.sql
create mode 100644 benchmarks/queries-tpcds/q73.sql
create mode 100644 benchmarks/queries-tpcds/q74.sql
create mode 100644 benchmarks/queries-tpcds/q75.sql
create mode 100644 benchmarks/queries-tpcds/q76.sql
create mode 100644 benchmarks/queries-tpcds/q77.sql
create mode 100644 benchmarks/queries-tpcds/q78.sql
create mode 100644 benchmarks/queries-tpcds/q79.sql
create mode 100644 benchmarks/queries-tpcds/q8.sql
create mode 100644 benchmarks/queries-tpcds/q80.sql
create mode 100644 benchmarks/queries-tpcds/q81.sql
create mode 100644 benchmarks/queries-tpcds/q82.sql
create mode 100644 benchmarks/queries-tpcds/q83.sql
create mode 100644 benchmarks/queries-tpcds/q84.sql
create mode 100644 benchmarks/queries-tpcds/q85.sql
create mode 100644 benchmarks/queries-tpcds/q86.sql
create mode 100644 benchmarks/queries-tpcds/q87.sql
create mode 100644 benchmarks/queries-tpcds/q88.sql
create mode 100644 benchmarks/queries-tpcds/q89.sql
create mode 100644 benchmarks/queries-tpcds/q9.sql
create mode 100644 benchmarks/queries-tpcds/q90.sql
create mode 100644 benchmarks/queries-tpcds/q91.sql
create mode 100644 benchmarks/queries-tpcds/q92.sql
create mode 100644 benchmarks/queries-tpcds/q93.sql
create mode 100644 benchmarks/queries-tpcds/q94.sql
create mode 100644 benchmarks/queries-tpcds/q95.sql
create mode 100644 benchmarks/queries-tpcds/q96.sql
create mode 100644 benchmarks/queries-tpcds/q97.sql
create mode 100644 benchmarks/queries-tpcds/q98.sql
create mode 100644 benchmarks/queries-tpcds/q99.sql
create mode 100644 benchmarks/src/bin/tpcds.rs
create mode 100644 benchmarks/src/lib.rs
copy benchmarks/{tpch-gen.sh => tpcds-gen.sh} (53%)
copy dev/{docker/standalone-entrypoint.sh => vendor-tpcds-queries.sh} (53%)
create mode 100644 docs/source/contributors-guide/benchmarking.md
create mode 100644 docs/source/upgrading/55.0.0.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
