This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/proto-5f30c81d2c
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 6e02bfe10f chore(deps): bump the proto group with 2 updates
add 1529dbd0ec chore(deps): bump url from 2.5.4 to 2.5.6 (#17283)
add cea3ada934 fix determinism of HashJoinExec bounds filter creation
(#17280)
add 9e062dfb41 Improve documentation for Signature, Volatility, and
TypeSignature (#17264)
add f363e38266 Consolidate Parquet Metadata handling into its own module
and struct `DFParquetMetadata` (#17127)
add 3f96c3f3fb [main] Forward port `49.0.2` version and changelog (#17277)
(#17287)
add 18c5a6c82f Only update TopK dynamic filters if the new ones are more
selective (#16433)
add 2f51d5fdc1 Document schema merging. (#17249)
add 73ad4926d9 feat: Make parquet_encryption a non-default feature (#17137)
add bd249ba5b9 Add documentation for UNION schema handling. (#17248)
add cf3b456727 Replace π-related bound constants with next_up/next_down
(#16823)
add be3842b55d chore: add example for how to use TrackConsumersPool
(#17213)
add ee95caea8d feat: allow to `spawn`/`spawn_blocking` on a provided
runtime in `RecordBatchReceiverStreamBuilder` (#17239)
add b63a9607c3 minor: Remove extra line break in explain physical plan
(#17303)
add 85f879d41a Support from-first SQL syntax (#17295)
add 241e47d1c9 Support `avg(distinct)` for `float64` type (#17255)
add 72db63c38d chore: check the error message log (#17308)
add 8c65a41fe4 Expand sql_planner benchmark for benchmarking physical and
logical optimization. (#17276)
add fa265154bd Encapsulate early pruning in its own stream (#17293)
add 4925e6c67e fix: dataframe function count_all with alias (#17282)
add 2c9f42bae7 feat: Support SortMergeJoin proto serde (#17296)
add fd7df66724 feat(spark): implement Spark `bitmap` function
`bitmap_count` (#17179)
add 6368daf0b6 Implement `partition_statistics` API for `RepartitionExec`
(#17061)
add 76559df0cf fix: correct readme field in Cargo.toml to use string
format (#17310)
add 2d7e1de317 chore(deps): bump the proto group with 2 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6e02bfe10f)
\
N -- N -- N refs/heads/dependabot/cargo/main/proto-5f30c81d2c
(2d7e1de317)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/rust.yml | 2 +-
Cargo.lock | 99 ++--
Cargo.toml | 4 +-
README.md | 2 +-
datafusion-cli/Cargo.toml | 1 +
datafusion-examples/Cargo.toml | 2 +-
datafusion-examples/README.md | 2 +
.../examples/memory_pool_execution_plan.rs | 303 +++++++++++
.../examples/memory_pool_tracking.rs | 127 +++++
datafusion-testing | 2 +-
datafusion/common/src/config.rs | 4 +
datafusion/common/src/dfschema.rs | 14 +
datafusion/common/src/encryption.rs | 2 +
datafusion/common/src/scalar/consts.rs | 36 +-
datafusion/common/src/scalar/mod.rs | 2 -
datafusion/core/Cargo.toml | 3 +-
datafusion/core/benches/sql_planner.rs | 225 +++++++-
.../core/src/datasource/file_format/parquet.rs | 226 +++-----
datafusion/core/src/physical_planner.rs | 35 +-
datafusion/core/tests/catalog/memory.rs | 2 +-
.../core/tests/dataframe/dataframe_functions.rs | 25 +
datafusion/core/tests/parquet/custom_reader.rs | 26 +-
.../physical_optimizer/filter_pushdown/mod.rs | 2 +-
.../physical_optimizer/partition_statistics.rs | 102 ++++
datafusion/datasource-parquet/src/file_format.rs | 522 +++----------------
datafusion/datasource-parquet/src/metadata.rs | 566 +++++++++++++++++++++
datafusion/datasource-parquet/src/mod.rs | 1 +
datafusion/datasource-parquet/src/opener.rs | 105 +++-
datafusion/datasource-parquet/src/reader.rs | 35 +-
datafusion/datasource-parquet/src/source.rs | 2 +-
datafusion/execution/src/memory_pool/pool.rs | 48 +-
datafusion/execution/src/runtime_env.rs | 3 +-
datafusion/expr-common/src/signature.rs | 116 +++--
datafusion/expr/src/expr.rs | 104 +++-
datafusion/expr/src/logical_plan/plan.rs | 37 +-
datafusion/expr/src/udf.rs | 26 +-
datafusion/expr/src/utils.rs | 3 +
.../functions-aggregate-common/src/aggregate.rs | 2 +
.../src/aggregate/avg_distinct.rs} | 4 +-
.../src/aggregate/avg_distinct/numeric.rs | 78 +++
.../src/aggregate/sum_distinct.rs} | 6 +-
.../src/aggregate/sum_distinct/numeric.rs | 123 +++++
datafusion/functions-aggregate/src/average.rs | 131 ++---
datafusion/functions-aggregate/src/sum.rs | 89 +---
datafusion/optimizer/src/analyzer/type_coercion.rs | 37 ++
datafusion/physical-expr/Cargo.toml | 1 +
.../src/expressions/dynamic_filters.rs | 61 +--
datafusion/physical-plan/src/execution_plan.rs | 9 +
datafusion/physical-plan/src/joins/hash_join.rs | 21 +-
datafusion/physical-plan/src/repartition/mod.rs | 43 +-
datafusion/physical-plan/src/sorts/sort.rs | 33 +-
datafusion/physical-plan/src/stream.rs | 100 ++++
datafusion/physical-plan/src/topk/mod.rs | 182 +++++--
datafusion/proto/proto/datafusion.proto | 11 +
datafusion/proto/src/generated/pbjson.rs | 214 ++++++++
datafusion/proto/src/generated/prost.rs | 21 +-
datafusion/proto/src/physical_plan/mod.rs | 211 +++++++-
.../proto/tests/cases/roundtrip_physical_plan.rs | 88 +++-
datafusion/spark/Cargo.toml | 2 +-
.../spark/src/function/bitmap/bitmap_count.rs | 178 +++++++
.../spark/src/function/{url => bitmap}/mod.rs | 14 +-
datafusion/spark/src/function/mod.rs | 1 +
datafusion/spark/src/lib.rs | 2 +
datafusion/sql/src/select.rs | 9 +
datafusion/sqllogictest/Cargo.toml | 2 +-
datafusion/sqllogictest/test_files/aggregate.slt | 60 ++-
.../{spark/string/ascii.slt => from-first.slt} | 33 +-
.../sqllogictest/test_files/parquet_statistics.slt | 9 +-
.../{string/ascii.slt => bitmap/bitmap_count.slt} | 39 +-
dev/changelog/{46.0.1.md => 49.0.2.md} | 19 +-
docs/source/user-guide/configs.md | 2 +-
docs/source/user-guide/sql/select.md | 14 +
72 files changed, 3532 insertions(+), 1133 deletions(-)
create mode 100644 datafusion-examples/examples/memory_pool_execution_plan.rs
create mode 100644 datafusion-examples/examples/memory_pool_tracking.rs
create mode 100644 datafusion/datasource-parquet/src/metadata.rs
copy
datafusion/{sqllogictest/src/engines/datafusion_substrait_roundtrip_engine/mod.rs
=> functions-aggregate-common/src/aggregate/avg_distinct.rs} (92%)
create mode 100644
datafusion/functions-aggregate-common/src/aggregate/avg_distinct/numeric.rs
copy datafusion/{physical-expr/src/statistics/mod.rs =>
functions-aggregate-common/src/aggregate/sum_distinct.rs} (88%)
create mode 100644
datafusion/functions-aggregate-common/src/aggregate/sum_distinct/numeric.rs
create mode 100644 datafusion/spark/src/function/bitmap/bitmap_count.rs
copy datafusion/spark/src/function/{url => bitmap}/mod.rs (81%)
copy datafusion/sqllogictest/test_files/{spark/string/ascii.slt =>
from-first.slt} (80%)
copy datafusion/sqllogictest/test_files/spark/{string/ascii.slt =>
bitmap/bitmap_count.slt} (59%)
copy dev/changelog/{46.0.1.md => 49.0.2.md} (59%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org
For additional commands, e-mail: commits-h...@datafusion.apache.org
