This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/substrait-0.59.1
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit d609d1853d chore(deps): bump substrait from 0.58.0 to 0.59.1
add 8698d954e5 Extract complex default impls from AggregateUDFImpl trait
(#17391)
add 241b669e1b Improve Hash and Ord speed for dyn LogicalType (#17437)
add e5dcc8c04f fix: lazy evaluation for coalesce (#17357)
add b084aa4934 fix: Implement AggregateUDFImpl::reverse_expr for StringAgg
(#17165)
add d0e68a4c8a fix: Support aggregate expressions in `QUALIFY` (#17313)
add 1d9e138450 chore: make tablefunction clonable (#17457)
add 167411e930 chore(deps): bump wasm-bindgen-test from 0.3.50 to 0.3.51
(#17470)
add 2a8435e605 chore(deps): bump log from 0.4.27 to 0.4.28 (#17471)
add 7b16d6be1f Support csv truncated rows in datafusion (#17465)
add c83466c20e chore(deps): bump indexmap from 2.11.0 to 2.11.1 (#17484)
add 26106a2aa8 Auto detect hive column partitioning with
ListingTableFactory / `CREATE EXTERNAL TABLE` (#17232)
add 1197454ae1 chore(deps): bump chrono from 0.4.41 to 0.4.42 (#17483)
add fcd820e3af feat: Implement `DFSchema.print_schema_tree()` method
(#17459)
add f99a6cf6ab Improve `PartialEq`, `Eq` speed for `LexOrdering`, make
`PartialEq` and `PartialOrd` consistent (#17442)
add a96dcc82c0 Fix array types coercion: preserve child element
nullability for list types (#17306)
add fc5888b49b feat(spark): implement Spark `length` function (#17475)
add da1e7ae2e5 better preserve statistics when applying limits (#17381)
add 5b833b9a63 Refactor HashJoinExec to progressively accumulate dynamic
filter bounds instead of computing them after data is accumulated (#17444)
add 0c7d8307a8 Fix `PartialOrd` for logical plan nodes and expressions
(#17438)
add da3d90ab1b synchronize partition bounds reporting in HashJoin (#17452)
add fe7023d5c9 chore(deps): bump sqllogictest from 0.28.3 to 0.28.4
(#17500)
add 5bb476f014 chore(deps): bump tempfile from 3.21.0 to 3.22.0 (#17499)
add 9398af39d7 refactor: Move `SMJ` tests into own file (#17495)
add ab108a50d7 move MinAggregator and MaxAggregator to
functions-aggregate-common (#17492)
add bb7fbe5941 Update datafusion-testing pin to update expected output for
extended tests (#17490)
add a1709b6ead update physical-plan to use
datafusion-functions-aggregate-common for Min/MaxAccumulator (#17502)
add a281b251a2 Always use 'indent' format for explain verbose (#17481)
add 14a7adec05 Fix ambiguous column names in substrait conversion as a
result of literals having the same name during conversion. (#17299)
add 1aca8774d3 chore(deps): bump substrait from 0.58.0 to 0.59.1
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d609d1853d)
\
N -- N -- N refs/heads/dependabot/cargo/main/substrait-0.59.1
(1aca8774d3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 125 +-
Cargo.toml | 4 +-
datafusion-testing | 2 +-
datafusion/catalog/src/table.rs | 2 +-
datafusion/common/src/config.rs | 18 +
datafusion/common/src/dfschema.rs | 682 +++++
datafusion/common/src/stats.rs | 298 ++-
datafusion/common/src/types/logical.rs | 8 +-
datafusion/core/src/datasource/file_format/csv.rs | 179 +-
.../core/src/datasource/file_format/options.rs | 18 +-
datafusion/core/src/datasource/listing/table.rs | 3 +
.../core/src/datasource/listing_table_factory.rs | 127 +-
.../core/tests/custom_sources_cases/statistics.rs | 10 +-
.../physical_optimizer/filter_pushdown/mod.rs | 11 +-
.../physical_optimizer/filter_pushdown/util.rs | 9 +
.../physical_optimizer/partition_statistics.rs | 19 +-
datafusion/datasource-csv/src/file_format.rs | 19 +-
datafusion/datasource-csv/src/source.rs | 17 +-
datafusion/datasource-parquet/Cargo.toml | 2 +-
datafusion/datasource-parquet/src/metadata.rs | 2 +-
datafusion/expr/src/expr.rs | 5 +-
datafusion/expr/src/lib.rs | 6 +-
datafusion/expr/src/logical_plan/ddl.rs | 27 +-
datafusion/expr/src/logical_plan/dml.rs | 4 +
datafusion/expr/src/logical_plan/extension.rs | 7 +-
datafusion/expr/src/logical_plan/plan.rs | 48 +-
datafusion/expr/src/type_coercion/functions.rs | 78 +-
datafusion/expr/src/udaf.rs | 515 ++--
datafusion/expr/src/udwf.rs | 3 +-
.../functions-aggregate-common/src/min_max.rs | 448 +++-
datafusion/functions-aggregate/src/array_agg.rs | 2 +-
datafusion/functions-aggregate/src/min_max.rs | 450 +---
datafusion/functions-aggregate/src/string_agg.rs | 4 +
datafusion/functions/src/core/coalesce.rs | 88 +-
.../optimizer/src/optimize_projections/mod.rs | 4 +
datafusion/optimizer/src/push_down_filter.rs | 5 +-
datafusion/optimizer/src/push_down_limit.rs | 10 +-
datafusion/physical-expr-common/src/sort_expr.rs | 57 +-
datafusion/physical-plan/Cargo.toml | 2 +-
datafusion/physical-plan/src/coalesce_batches.rs | 9 +-
.../physical-plan/src/coalesce_partitions.rs | 2 +-
.../physical-plan/src/joins/hash_join/exec.rs | 193 +-
.../src/joins/hash_join/shared_bounds.rs | 59 +-
.../physical-plan/src/joins/hash_join/stream.rs | 44 +-
.../src/joins/sort_merge_join/exec.rs | 2705 -------------------
.../physical-plan/src/joins/sort_merge_join/mod.rs | 3 +
.../src/joins/sort_merge_join/tests.rs | 2715 ++++++++++++++++++++
datafusion/physical-plan/src/limit.rs | 18 +-
datafusion/physical-plan/src/sorts/sort.rs | 19 +-
.../proto-common/proto/datafusion_common.proto | 1 +
datafusion/proto-common/src/from_proto/mod.rs | 1 +
datafusion/proto-common/src/generated/pbjson.rs | 22 +
datafusion/proto-common/src/generated/prost.rs | 3 +
datafusion/proto-common/src/to_proto/mod.rs | 1 +
datafusion/proto/proto/datafusion.proto | 1 +
.../proto/src/generated/datafusion_proto_common.rs | 3 +
datafusion/proto/src/generated/pbjson.rs | 18 +
datafusion/proto/src/generated/prost.rs | 2 +
datafusion/proto/src/logical_plan/file_formats.rs | 6 +
datafusion/proto/src/physical_plan/mod.rs | 1 +
datafusion/spark/src/function/string/length.rs | 282 ++
datafusion/spark/src/function/string/mod.rs | 9 +-
datafusion/sql/src/select.rs | 145 +-
datafusion/sql/src/statement.rs | 9 +-
datafusion/sql/src/utils.rs | 19 +-
datafusion/sql/tests/cases/diagnostic.rs | 2 +-
datafusion/sql/tests/sql_integration.rs | 61 +
datafusion/sqllogictest/Cargo.toml | 2 +-
datafusion/sqllogictest/test_files/aggregate.slt | 53 +-
datafusion/sqllogictest/test_files/explain.slt | 92 +
.../sqllogictest/test_files/information_schema.slt | 2 +
.../sqllogictest/test_files/insert_to_external.slt | 28 +
.../test_files/listing_table_partitions.slt | 75 +
.../sqllogictest/test_files/parquet_statistics.slt | 2 +-
datafusion/sqllogictest/test_files/qualify.slt | 72 +
datafusion/sqllogictest/test_files/select.slt | 16 +-
.../test_files/spark/string/char_length.slt | 30 +-
.../test_files/spark/string/character_length.slt | 30 +-
.../sqllogictest/test_files/spark/string/len.slt | 22 +-
.../test_files/spark/string/length.slt | 22 +-
datafusion/substrait/Cargo.toml | 1 +
.../src/logical_plan/consumer/rel/project_rel.rs | 15 +-
.../substrait/tests/cases/consumer_integration.rs | 40 +-
datafusion/substrait/tests/cases/logical_plans.rs | 41 +
.../tests/cases/roundtrip_logical_plan.rs | 2 +
...mbiguate_literals_with_same_name.substrait.json | 287 +++
datafusion/wasmtest/Cargo.toml | 2 +-
docs/source/library-user-guide/upgrading.md | 11 +
docs/source/user-guide/cli/datasources.md | 24 +
docs/source/user-guide/configs.md | 1 +
docs/source/user-guide/sql/ddl.md | 29 +
91 files changed, 6705 insertions(+), 3865 deletions(-)
create mode 100644 datafusion/physical-plan/src/joins/sort_merge_join/tests.rs
create mode 100644 datafusion/spark/src/function/string/length.rs
create mode 100644
datafusion/sqllogictest/test_files/listing_table_partitions.slt
create mode 100644
datafusion/substrait/tests/testdata/test_plans/disambiguate_literals_with_same_name.substrait.json
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org
For additional commands, e-mail: commits-h...@datafusion.apache.org
