This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/substrait-0.59.0
in repository https://gitbox.apache.org/repos/asf/datafusion.git
discard 620e7c1b6a chore(deps): bump substrait from 0.58.0 to 0.59.0
add c3ec964445 chore: Remove attributes to allow dead_code that aren't
relevant anymore (#16953)
add 764d547edf speedup `date_trunc` (~7x faster) in some cases (#16859)
add b7c014a2c8 fix: regex bench (#16890)
add 5421825b62 feat: add multi level merge sort that will always fit in
memory (#15700)
add aab44fdaae feat: [datafusion-spark] Implement `next_day` function
(#16780)
add 56394e0a50 feat: Support distinct window for sum (#16943)
add 6f74fb047d chore(deps): bump rand from 0.9.1 to 0.9.2 (#16960)
add cca9d4c537 chore(deps): bump ctor from 0.4.2 to 0.4.3 (#16961)
add 949917a6e0 Remove references to DataFusion for Ray sub project now
that it is no longer maintained (#16966)
add f2086f3fa7 Add `temp_directory` and `max_temp_directory_size` runtime
config variables (#16934)
add 94e85488df disallow pushdown of volatile functions (#16861)
add 0183244a42 remove warning from every file open (#16968)
add 9b27952303 Pin github actions to commit sha (#16964)
add b10f453e7b Enable physical filter pushdown for hash joins (#16954)
add 677f7231be feat(spark): implement Spark math function rint (#16924)
add 5cdb7a2404 Include full DataType in TopKAggregateStream results
add 3dc3aaa86e Use tokio::task::coop::poll_proceed by default in
CooperativeStream (#16748)
add 853eee09b3 Add benchmark utility to profile peak memory usage (#16814)
add b1920145b4 chore(deps): bump substrait from 0.58.0 to 0.59.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (620e7c1b6a)
\
N -- N -- N refs/heads/dependabot/cargo/main/substrait-0.59.0
(b1920145b4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/audit.yml | 2 +-
.github/workflows/dependencies.yml | 2 +-
.github/workflows/dev.yml | 8 +-
.github/workflows/docs.yaml | 6 +-
.github/workflows/docs_pr.yaml | 4 +-
.github/workflows/extended.yml | 12 +-
.github/workflows/labeler.yml | 4 +-
.github/workflows/large_files.yml | 2 +-
.github/workflows/pr_comment_commands.yml | 4 +-
.github/workflows/rust.yml | 60 +-
.github/workflows/stale.yml | 2 +-
Cargo.lock | 577 ++++++++++--------
Cargo.toml | 2 +-
README.md | 2 -
benchmarks/Cargo.toml | 3 +
benchmarks/README.md | 61 ++
benchmarks/src/bin/mem_profile.rs | 360 ++++++++++++
benchmarks/src/clickbench.rs | 10 +-
benchmarks/src/h2o.rs | 19 +-
benchmarks/src/imdb/mod.rs | 3 +
benchmarks/src/imdb/run.rs | 15 +-
benchmarks/src/sort_tpch.rs | 16 +-
benchmarks/src/tpch/mod.rs | 3 +
benchmarks/src/tpch/run.rs | 15 +-
benchmarks/src/util/memory.rs | 57 ++
benchmarks/src/util/mod.rs | 2 +
datafusion/common-runtime/Cargo.toml | 2 +-
datafusion/core/src/execution/context/mod.rs | 26 +-
datafusion/core/tests/fuzz_cases/aggregate_fuzz.rs | 23 +-
datafusion/core/tests/fuzz_cases/mod.rs | 2 +
datafusion/core/tests/fuzz_cases/once_exec.rs | 115 ++++
.../spilling_fuzz_in_memory_constrained_env.rs | 654 +++++++++++++++++++++
.../physical_optimizer/filter_pushdown/mod.rs | 303 +++++++++-
.../physical_optimizer/filter_pushdown/util.rs | 5 +-
datafusion/core/tests/sql/runtime_config.rs | 48 ++
datafusion/datasource-parquet/src/source.rs | 6 -
datafusion/execution/src/runtime_env.rs | 35 +-
datafusion/ffi/src/udaf/mod.rs | 3 +-
datafusion/functions-aggregate/src/sum.rs | 127 +++-
datafusion/functions/benches/regx.rs | 2 +
datafusion/functions/src/datetime/date_trunc.rs | 88 ++-
.../src/expressions/dynamic_filters.rs | 2 -
.../physical-optimizer/src/filter_pushdown.rs | 358 +++++++++--
.../physical-plan/src/aggregates/row_hash.rs | 32 +-
.../src/aggregates/topk/hash_table.rs | 34 +-
datafusion/physical-plan/src/coop.rs | 20 +-
datafusion/physical-plan/src/execution_plan.rs | 22 +-
datafusion/physical-plan/src/filter_pushdown.rs | 35 +-
datafusion/physical-plan/src/joins/hash_join.rs | 48 +-
datafusion/physical-plan/src/sorts/mod.rs | 1 +
.../physical-plan/src/sorts/multi_level_merge.rs | 449 ++++++++++++++
datafusion/physical-plan/src/sorts/sort.rs | 54 +-
.../physical-plan/src/sorts/streaming_merge.rs | 92 ++-
.../physical-plan/src/spill/spill_manager.rs | 90 ++-
datafusion/spark/src/function/datetime/mod.rs | 11 +-
datafusion/spark/src/function/datetime/next_day.rs | 226 +++++++
datafusion/spark/src/function/math/mod.rs | 5 +-
datafusion/spark/src/function/math/rint.rs | 165 ++++++
.../test_files/parquet_filter_pushdown.slt | 15 +
.../test_files/spark/datetime/next_day.slt | 62 +-
.../sqllogictest/test_files/spark/math/rint.slt | 94 ++-
datafusion/sqllogictest/test_files/window.slt | 85 ++-
docs/source/index.rst | 2 -
docs/source/user-guide/configs.md | 8 +-
docs/source/user-guide/sql/scalar_functions.md | 2 +
65 files changed, 4081 insertions(+), 521 deletions(-)
create mode 100644 benchmarks/src/bin/mem_profile.rs
create mode 100644 benchmarks/src/util/memory.rs
create mode 100644 datafusion/core/tests/fuzz_cases/once_exec.rs
create mode 100644
datafusion/core/tests/fuzz_cases/spilling_fuzz_in_memory_constrained_env.rs
create mode 100644 datafusion/physical-plan/src/sorts/multi_level_merge.rs
create mode 100644 datafusion/spark/src/function/datetime/next_day.rs
create mode 100644 datafusion/spark/src/function/math/rint.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org
For additional commands, e-mail: commits-h...@datafusion.apache.org
