This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/main/proto-5f30c81d2c in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 10d89224f2 chore(deps): bump the proto group with 2 updates add c83466c20e chore(deps): bump indexmap from 2.11.0 to 2.11.1 (#17484) add 26106a2aa8 Auto detect hive column partitioning with ListingTableFactory / `CREATE EXTERNAL TABLE` (#17232) add 1197454ae1 chore(deps): bump chrono from 0.4.41 to 0.4.42 (#17483) add fcd820e3af feat: Implement `DFSchema.print_schema_tree()` method (#17459) add f99a6cf6ab Improve `PartialEq`, `Eq` speed for `LexOrdering`, make `PartialEq` and `PartialOrd` consistent (#17442) add a96dcc82c0 Fix array types coercion: preserve child element nullability for list types (#17306) add fc5888b49b feat(spark): implement Spark `length` function (#17475) add da1e7ae2e5 better preserve statistics when applying limits (#17381) add 5b833b9a63 Refactor HashJoinExec to progressively accumulate dynamic filter bounds instead of computing them after data is accumulated (#17444) add 0c7d8307a8 Fix `PartialOrd` for logical plan nodes and expressions (#17438) add da3d90ab1b synchronize partition bounds reporting in HashJoin (#17452) new 5d069f66a2 chore(deps): bump the proto group with 2 updates This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (10d89224f2) \ N -- N -- N refs/heads/dependabot/cargo/main/proto-5f30c81d2c (5d069f66a2) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: Cargo.lock | 70 +-- Cargo.toml | 4 +- datafusion/common/src/config.rs | 5 + datafusion/common/src/dfschema.rs | 682 +++++++++++++++++++++ datafusion/common/src/stats.rs | 298 ++++++++- datafusion/core/src/datasource/listing/table.rs | 3 + .../core/src/datasource/listing_table_factory.rs | 127 +++- .../core/tests/custom_sources_cases/statistics.rs | 10 +- .../physical_optimizer/filter_pushdown/mod.rs | 11 +- .../physical_optimizer/filter_pushdown/util.rs | 9 + .../physical_optimizer/partition_statistics.rs | 19 +- datafusion/expr/src/expr.rs | 5 +- datafusion/expr/src/logical_plan/ddl.rs | 27 +- datafusion/expr/src/logical_plan/dml.rs | 4 + datafusion/expr/src/logical_plan/extension.rs | 7 +- datafusion/expr/src/logical_plan/plan.rs | 48 +- datafusion/expr/src/type_coercion/functions.rs | 78 ++- datafusion/expr/src/udaf.rs | 6 +- datafusion/expr/src/udwf.rs | 3 +- datafusion/functions-aggregate/src/array_agg.rs | 2 +- .../optimizer/src/optimize_projections/mod.rs | 4 + datafusion/optimizer/src/push_down_filter.rs | 5 +- datafusion/optimizer/src/push_down_limit.rs | 10 +- datafusion/physical-expr-common/src/sort_expr.rs | 57 +- datafusion/physical-plan/Cargo.toml | 2 +- datafusion/physical-plan/src/coalesce_batches.rs | 9 +- .../physical-plan/src/coalesce_partitions.rs | 2 +- .../physical-plan/src/joins/hash_join/exec.rs | 193 +++++- .../src/joins/hash_join/shared_bounds.rs | 59 +- .../physical-plan/src/joins/hash_join/stream.rs | 44 +- datafusion/physical-plan/src/limit.rs | 18 +- datafusion/physical-plan/src/sorts/sort.rs | 19 +- datafusion/spark/src/function/string/length.rs | 282 +++++++++ datafusion/spark/src/function/string/mod.rs | 9 +- datafusion/sql/src/statement.rs | 2 +- .../sqllogictest/test_files/information_schema.slt | 2 + .../sqllogictest/test_files/insert_to_external.slt | 28 + .../test_files/listing_table_partitions.slt | 75 +++ .../sqllogictest/test_files/parquet_statistics.slt | 2 +- .../test_files/spark/string/char_length.slt | 30 +- .../test_files/spark/string/character_length.slt | 30 +- .../sqllogictest/test_files/spark/string/len.slt | 22 +- .../test_files/spark/string/length.slt | 22 +- .../tests/cases/roundtrip_logical_plan.rs | 2 + docs/source/library-user-guide/upgrading.md | 11 + docs/source/user-guide/cli/datasources.md | 24 + docs/source/user-guide/configs.md | 1 + docs/source/user-guide/sql/ddl.md | 29 + 48 files changed, 2108 insertions(+), 303 deletions(-) create mode 100644 datafusion/spark/src/function/string/length.rs create mode 100644 datafusion/sqllogictest/test_files/listing_table_partitions.slt --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org For additional commands, e-mail: commits-h...@datafusion.apache.org