This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/proto-dfa7aae14e
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit f7704fd13b chore(deps): bump prost from 0.13.5 to 0.14.1 in the proto
group
add 0104822e91 Implement `AsRef` for `Expr` (#17819)
add 0b160c567f Cleanup user guide known users section (#17834)
add 6c0d1c5c5d chore(deps): bump taiki-e/install-action from 2.62.13 to
2.62.14 (#17840)
add 7f25819c6f Fix the doc about row_groups pruning metrics in
explain_usage.md (#17846)
add 843e6f4779 Replace `auto_doc_cfg` with `doc_cfg` (#17845)
add 52565a7ac3 chore(deps): bump petgraph from 0.8.2 to 0.8.3 (#17842)
add 4eacb60467 Enable Projection Pushdown Optimization for Recursive CTEs
(#16696)
add 615bcee086 docs: Add rerun.io to known users guide (#17825)
add 35f45b544d chore: fix typos & pin action hashes (#17855)
add f1246a9ea8 perf: Optimize CASE for any WHEN false (#17835)
add 94b68cb3c2 fix: correct edge case where null haystack returns false
instead of null (#17818)
add 97e00efff3 #17411 Relax constraint that file sort order must only
reference individual columns (#17419)
add e0222f0727 Clarify email reply instructions for invitations (#17851)
add 6a61304916 fix: ignore `DataType::Null` in possible types during csv
type inference (#17796)
add bd95a6b8cb feat: Support swap for `RightMark` Join (#17651)
add 297e537bdf Add missing parenthesis in features documentation (#17869)
add a9d04606b4 minor: Include consumer name in OOM message (#17870)
add 9611ac80d1 Implement `partition_statistics` API for `InterleaveExec`
(#17051)
add 3ee52f85fd Add `CastColumnExpr` for struct-aware column casting
(#17773)
add 8e49d13bc7 chore(deps): bump taiki-e/install-action from 2.62.14 to
2.62.16 (#17879)
add b170aaede2 chore(deps): bump crate-ci/typos from 1.37.0 to 1.37.1
(#17878)
add d3ca16e9a7 Add notes for DataSinkExec (#17873)
add b81073ad4c feat: makes Expr::not normalize more negations (#17848)
add ae6f8eb1a0 Fix failing CI caused by hash collisions (#17886)
add 1ac818611c Minor: reuse test schemas in simplify tests (#17864)
add 7dff1e1f32 minor: Make `FunctionRegistry` `udafs` and `udwfs` methods
mandatory (#17847)
add 71512e676d docs: Improve documentation for FunctionFactory / CREATE
FUNCTION (#17859)
add a7b113c455 Support `AS`, `UNION`, `INTERSECTION`, `EXCEPT`,
`AGGREGATE` pipe operators (#17312)
add 10a437b826 [forward port] Change version to 50.1.0 and add changelog
(#17748) (#17826)
add 00f05c2212 Make limit pushdown work for SortPreservingMergeExec
(#17893)
add 21b6df19b8 chore(deps): bump taiki-e/install-action from 2.62.16 to
2.62.17 (#17896)
add 0f3cf27fb9 perf: Faster `string_agg()` aggregate function (1000x speed
for no DISTINCT and ORDER case) (#17837)
add daeb6597a0 Consolidate `apply_schema_adapter_tests` (#17905)
add 76904e837d optimizer: allow projection pushdown through aliased
recursive CTE references (#17875)
add 5e558b2f0b fix with_predicate() reset Metrics (#17858)
add d273ffbc9f Improve `InListExpr` plan display (#17884)
add 182d5dc5e4 Export JoinSetTracerError from datafusion-common-runtime
(#17877)
add 71d741504a Clippy to `extended_tests` (#17922)
add 9e8ec548fb chore: rename Schema `print_schema_tree` to `tree_string`
(#17919)
add bcbc632e24 chore: utilize trait upcasting for AsyncScalarUDF PartialEq
& Hash (#17872)
add 82cd7f3cdb fix: optimizer `common_sub_expression_eliminate` fails in a
window function (#17852)
add e8b27523db chore(deps): bump prost from 0.13.5 to 0.14.1 in the proto
group
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f7704fd13b)
\
N -- N -- N refs/heads/dependabot/cargo/main/proto-dfa7aae14e
(e8b27523db)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../setup-macos-aarch64-builder/action.yaml | 2 +-
.github/workflows/audit.yml | 2 +-
.github/workflows/rust.yml | 8 +-
Cargo.lock | 88 ++---
Cargo.toml | 74 ++--
ci/scripts/rust_clippy.sh | 2 +-
datafusion-cli/src/lib.rs | 2 +-
.../snapshots/[email protected] | 2 +-
.../cli_top_memory_consumers@top3_default.snap | 2 +-
datafusion/catalog-listing/src/mod.rs | 2 +-
datafusion/catalog/src/lib.rs | 2 +-
datafusion/catalog/src/stream.rs | 17 +-
datafusion/common-runtime/src/lib.rs | 4 +-
datafusion/common/src/dfschema.rs | 24 +-
datafusion/common/src/join_type.rs | 2 +
datafusion/common/src/lib.rs | 2 +-
datafusion/common/src/scalar/mod.rs | 2 +-
datafusion/core/src/datasource/file_format/csv.rs | 112 +++++-
datafusion/core/src/datasource/listing/table.rs | 85 +++--
datafusion/core/src/execution/context/mod.rs | 45 ++-
datafusion/core/src/lib.rs | 2 +-
.../some_empty_with_header/a_empty.csv} | 0
.../data/empty_files/some_empty_with_header/b.csv | 3 +
.../some_empty_with_header/c_nulls_column.csv} | 1 +
datafusion/core/tests/fuzz_cases/join_fuzz.rs | 8 +-
.../memory_limit_validation/sort_mem_validation.rs | 2 +-
datafusion/core/tests/memory_limit/mod.rs | 30 +-
datafusion/core/tests/parquet/schema_adapter.rs | 177 +++++++++
.../physical_optimizer/filter_pushdown/mod.rs | 4 +-
.../tests/physical_optimizer/join_selection.rs | 58 ++-
.../physical_optimizer/partition_statistics.rs | 108 +++++-
datafusion/core/tests/sql/explain_analyze.rs | 125 +++++++
.../tests/user_defined/user_defined_aggregates.rs | 3 +
.../user_defined/user_defined_scalar_functions.rs | 2 +
.../user_defined/user_defined_window_functions.rs | 2 +
datafusion/datasource-avro/src/mod.rs | 2 +-
datafusion/datasource-csv/src/file_format.rs | 14 +-
datafusion/datasource-parquet/src/source.rs | 7 -
.../tests/apply_schema_adapter_tests.rs | 206 -----------
datafusion/datasource/src/file_scan_config.rs | 42 +--
datafusion/datasource/src/memory.rs | 24 +-
datafusion/datasource/src/mod.rs | 2 +-
datafusion/datasource/src/sink.rs | 5 +
datafusion/doc/src/lib.rs | 2 +-
datafusion/execution/src/lib.rs | 2 +-
datafusion/execution/src/memory_pool/pool.rs | 22 +-
datafusion/expr-common/src/lib.rs | 2 +-
datafusion/expr-common/src/signature.rs | 1 -
datafusion/expr/src/async_udf.rs | 134 ++++++-
datafusion/expr/src/expr.rs | 60 +++
datafusion/expr/src/lib.rs | 2 +-
datafusion/expr/src/logical_plan/builder.rs | 5 +-
datafusion/expr/src/logical_plan/ddl.rs | 22 +-
datafusion/expr/src/operation.rs | 15 +-
datafusion/expr/src/registry.rs | 14 +-
datafusion/ffi/src/lib.rs | 2 +-
datafusion/functions-aggregate-common/src/lib.rs | 2 +-
datafusion/functions-aggregate/src/lib.rs | 2 +-
datafusion/functions-aggregate/src/string_agg.rs | 165 ++++++++-
datafusion/functions-nested/src/array_has.rs | 59 ++-
datafusion/functions-nested/src/lib.rs | 2 +-
datafusion/functions-table/src/lib.rs | 2 +-
datafusion/functions-window-common/src/lib.rs | 2 +-
datafusion/functions-window/src/lib.rs | 2 +-
datafusion/functions/src/lib.rs | 2 +-
datafusion/macros/src/user_doc.rs | 2 +-
.../src/decorrelate_predicate_subquery.rs | 49 ++-
datafusion/optimizer/src/lib.rs | 2 +-
.../optimizer/src/optimize_projections/mod.rs | 84 ++++-
.../optimizer/src/scalar_subquery_to_join.rs | 254 +++++++------
.../src/simplify_expressions/expr_simplifier.rs | 264 ++++++++-----
.../src/simplify_expressions/simplify_exprs.rs | 148 ++++++++
.../optimizer/tests/optimizer_integration.rs | 161 ++++++++
datafusion/physical-expr-adapter/src/lib.rs | 2 +-
datafusion/physical-expr-common/src/lib.rs | 2 +-
datafusion/physical-expr/Cargo.toml | 2 +-
datafusion/physical-expr/src/equivalence/class.rs | 5 +
datafusion/physical-expr/src/equivalence/mod.rs | 2 +-
.../physical-expr/src/equivalence/projection.rs | 94 ++++-
datafusion/physical-expr/src/expressions/case.rs | 1 -
.../physical-expr/src/expressions/cast_column.rs | 409 +++++++++++++++++++++
.../physical-expr/src/expressions/in_list.rs | 29 +-
datafusion/physical-expr/src/expressions/mod.rs | 2 +
datafusion/physical-expr/src/lib.rs | 8 +-
datafusion/physical-expr/src/physical_expr.rs | 29 +-
.../physical-optimizer/src/join_selection.rs | 6 +-
datafusion/physical-optimizer/src/lib.rs | 2 +-
.../src/limit_pushdown_past_window.rs | 17 +
datafusion/physical-plan/src/joins/cross_join.rs | 2 +-
.../physical-plan/src/joins/hash_join/exec.rs | 6 +-
.../physical-plan/src/joins/nested_loop_join.rs | 4 +-
.../src/joins/sort_merge_join/stream.rs | 73 ++--
.../src/joins/sort_merge_join/tests.rs | 40 +-
.../physical-plan/src/joins/symmetric_hash_join.rs | 9 +
datafusion/physical-plan/src/joins/utils.rs | 10 +-
datafusion/physical-plan/src/lib.rs | 2 +-
datafusion/physical-plan/src/union.rs | 5 +-
datafusion/proto-common/src/lib.rs | 2 +-
datafusion/proto/src/lib.rs | 2 +-
datafusion/spark/src/lib.rs | 2 +-
datafusion/sql/src/lib.rs | 2 +-
datafusion/sql/src/query.rs | 113 +++++-
datafusion/sqllogictest/data/composite_order.csv | 8 +
datafusion/sqllogictest/src/lib.rs | 2 +-
datafusion/sqllogictest/test_files/array.slt | 10 +-
datafusion/sqllogictest/test_files/cte.slt | 18 +-
datafusion/sqllogictest/test_files/ddl.slt | 6 +-
datafusion/sqllogictest/test_files/joins.slt | 30 ++
datafusion/sqllogictest/test_files/order.slt | 37 ++
.../sqllogictest/test_files/pipe_operator.slt | 88 +++++
datafusion/sqllogictest/test_files/subquery.slt | 2 +-
.../test_files/tpch/plans/q16.slt.part | 2 +-
.../test_files/tpch/plans/q19.slt.part | 4 +-
.../test_files/tpch/plans/q22.slt.part | 4 +-
datafusion/sqllogictest/test_files/window.slt | 27 +-
datafusion/substrait/src/lib.rs | 2 +-
datafusion/wasmtest/src/lib.rs | 2 +-
dev/changelog/50.1.0.md | 47 +++
docs/source/contributor-guide/inviting.md | 11 +-
docs/source/library-user-guide/upgrading.md | 19 +
docs/source/user-guide/configs.md | 2 +-
docs/source/user-guide/explain-usage.md | 8 +-
docs/source/user-guide/features.md | 2 +-
docs/source/user-guide/introduction.md | 17 +-
docs/source/user-guide/sql/select.md | 91 +++++
typos.toml | 3 +
126 files changed, 3262 insertions(+), 853 deletions(-)
copy datafusion/core/tests/data/{empty.csv =>
empty_files/some_empty_with_header/a_empty.csv} (100%)
create mode 100644
datafusion/core/tests/data/empty_files/some_empty_with_header/b.csv
copy datafusion/core/tests/data/{empty.csv =>
empty_files/some_empty_with_header/c_nulls_column.csv} (64%)
delete mode 100644
datafusion/datasource-parquet/tests/apply_schema_adapter_tests.rs
create mode 100644 datafusion/physical-expr/src/expressions/cast_column.rs
create mode 100644 datafusion/sqllogictest/data/composite_order.csv
create mode 100644 dev/changelog/50.1.0.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
