This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/datafusion-cli/main/home-0.5.11 in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 6fe6b77bd0 chore(deps): bump home from 0.5.9 to 0.5.11 in /datafusion-cli add 774d3cb99c implement display for ColumnarValue (#14220) add b9baa515ce chore(deps): bump indexmap from 2.7.0 to 2.7.1 in /datafusion-cli (#14260) add 54e95b0b7f chore(deps): bump serde_json from 1.0.135 to 1.0.137 in /datafusion-cli (#14261) add 633eef6b66 Add casting of `count` to `Int64` in `array_repeat` function to ensure consistent integer type handling (#14236) add 144ebf9a50 Minor: Update documentations for memory pool (#14278) add f9696b6a7a Extract useful methods from sqllogictest bin (#14267) add 1dad545cab fix: add support for Decimal128 and Decimal256 types in interval arithmetic (#14126) add 18f14abf3f Deprecate max statistics size properly (#14188) add f77579108d move projection pushdown optimization logic to ExecutionPlan trait (#14235) add d460bb434d consolidate tests and utils (#14298) add f510800ca2 Add more tests showing coercing behavior with literals (#14270) add 4dc97b2f9c bench: add array_agg benchmark (#14302) add 7c07948358 Complete moving PhysicalOptimizer into `datafusion-physical-optimizer` (#14300) add be56bd301e Minor: Update documentation about crate organization (#14304) add 0eebc0c7c0 Export `datafusion_physical_optimizer`, only use `datafusion` crate in the examples (#14305) add 3802adf685 doc: Add funnel.io to known users list (#14316) add 329fb9127a add tests to check precision loss fix (#14284) add 09a0844b56 Expose sqllogictest Error (#14313) add c1ca005ddf fix: run sqllogictest with complete (#14254) add eabbbaf4e7 refactor: switch BooleanBufferBuilder to NullBufferBuilder in unit tests of multi_group_by (#14325) add e3db3592a8 minor: add unit tests for monotonicity.rs (#14307) add 71996fba9b make AnalysisContext aware of empty sets to represent certainly false bounds (#14279) add 1920771d80 Add relation to alias expr in schema display (#14311) add 8d542ecc13 Improve deprecation message for MemoryExec (#14322) add dc445a1509 fix: LogicalPlan::get_parameter_types fails to return all placeholders (#14312) add ecc5694840 fix: FULL OUTER JOIN and LIMIT produces wrong results (#14338) add 7f0c71b129 Customize window frame support for dialect (#14288) add d051731181 refactor: switch BooleanBufferBuilder to NullBufferBuilder in a unit test of common_scalar (#14339) add f8063e840e Add `ColumnStatistics::Sum` (#14074) add 3a991e65f1 refactor: switch BooleanBufferBuilder to NullBufferBuilder in unit tests for unnest (#14321) add a4917d44c8 Increase MSRV to 1.81.0 (#14330) add 3281a72bc5 chore(deps): bump home from 0.5.9 to 0.5.11 in /datafusion-cli This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (6fe6b77bd0) \ N -- N -- N refs/heads/dependabot/cargo/datafusion-cli/main/home-0.5.11 (3281a72bc5) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: Cargo.toml | 4 +- datafusion-cli/Cargo.lock | 10 +- datafusion-cli/Cargo.toml | 2 +- datafusion-examples/Cargo.toml | 9 +- .../examples/advanced_parquet_index.rs | 31 +- datafusion-examples/examples/advanced_udaf.rs | 26 +- datafusion-examples/examples/advanced_udf.rs | 8 +- datafusion-examples/examples/advanced_udwf.rs | 22 +- datafusion-examples/examples/analyzer_rule.rs | 10 +- .../examples/composed_extension_codec.rs | 6 +- datafusion-examples/examples/csv_json_opener.rs | 2 +- datafusion-examples/examples/custom_file_format.rs | 7 +- datafusion-examples/examples/dataframe.rs | 8 +- .../examples/date_time_functions.rs | 2 +- .../examples/deserialize_to_struct.rs | 2 +- datafusion-examples/examples/expr_api.rs | 26 +- .../examples/file_stream_provider.rs | 13 +- .../examples/flight/flight_sql_server.rs | 2 +- datafusion-examples/examples/function_factory.rs | 36 +- datafusion-examples/examples/optimizer_rule.rs | 14 +- .../examples/parquet_exec_visitor.rs | 3 +- datafusion-examples/examples/parquet_index.rs | 26 +- datafusion-examples/examples/parse_sql_expr.rs | 6 +- datafusion-examples/examples/plan_to_sql.rs | 18 +- datafusion-examples/examples/planner_api.rs | 2 +- datafusion-examples/examples/pruning.rs | 5 +- datafusion-examples/examples/regexp.rs | 2 +- datafusion-examples/examples/remote_catalog.rs | 8 +- datafusion-examples/examples/simple_udaf.rs | 2 +- datafusion-examples/examples/simple_udf.rs | 4 +- datafusion-examples/examples/simple_udtf.rs | 12 +- datafusion-examples/examples/simple_udwf.rs | 7 +- datafusion-examples/examples/sql_analysis.rs | 4 +- datafusion-examples/examples/sql_dialect.rs | 2 +- datafusion-examples/examples/sql_frontend.rs | 17 +- datafusion-examples/examples/sql_query.rs | 4 +- datafusion/common/src/config.rs | 78 +- .../common/src/file_options/parquet_writer.rs | 10 +- datafusion/common/src/scalar/mod.rs | 11 +- datafusion/common/src/stats.rs | 173 +- .../core/src/datasource/physical_plan/csv.rs | 33 + .../src/datasource/physical_plan/parquet/mod.rs | 35 +- .../src/datasource/physical_plan/parquet/opener.rs | 7 +- .../physical_plan/parquet/page_filter.rs | 9 +- .../physical_plan/parquet/row_group_filter.rs | 12 +- datafusion/core/src/datasource/statistics.rs | 6 +- datafusion/core/src/execution/session_state.rs | 19 +- datafusion/core/src/lib.rs | 40 +- datafusion/core/src/physical_optimizer/mod.rs | 28 - .../core/src/physical_optimizer/optimizer.rs | 124 - .../src/physical_optimizer/projection_pushdown.rs | 2792 -------------------- .../core/tests/custom_sources_cases/statistics.rs | 2 + datafusion/core/tests/memory_limit/mod.rs | 40 +- .../physical_optimizer/aggregate_statistics.rs | 29 +- .../combine_partial_final_agg.rs | 5 +- .../physical_optimizer/enforce_distribution.rs | 13 +- .../tests/physical_optimizer/enforce_sorting.rs | 12 +- .../tests/physical_optimizer/join_selection.rs | 1494 +++++++++++ .../tests/physical_optimizer/limit_pushdown.rs | 490 ++++ .../limited_distinct_aggregation.rs | 8 +- datafusion/core/tests/physical_optimizer/mod.rs | 34 +- .../physical_optimizer/projection_pushdown.rs | 1403 ++++++++++ .../replace_with_order_preserving_variants.rs | 5 +- .../tests/physical_optimizer/sanity_checker.rs | 18 +- .../tests/physical_optimizer}/test_utils.rs | 37 +- datafusion/execution/src/memory_pool/mod.rs | 9 +- datafusion/expr-common/Cargo.toml | 2 - datafusion/expr-common/src/columnar_value.rs | 62 +- datafusion/expr-common/src/interval_arithmetic.rs | 811 +++++- datafusion/expr/src/expr.rs | 37 +- datafusion/expr/src/logical_plan/plan.rs | 25 +- datafusion/functions-aggregate/Cargo.toml | 4 + .../functions-aggregate/benches/array_agg.rs | 186 ++ datafusion/functions-nested/src/repeat.rs | 51 +- datafusion/functions/src/math/monotonicity.rs | 402 +++ datafusion/optimizer/src/lib.rs | 4 +- datafusion/optimizer/src/push_down_limit.rs | 1 - datafusion/physical-expr/src/analysis.rs | 185 +- datafusion/physical-expr/src/expressions/cast.rs | 40 + datafusion/physical-optimizer/Cargo.toml | 1 - .../physical-optimizer/src/join_selection.rs | 1550 +---------- datafusion/physical-optimizer/src/lib.rs | 7 +- .../physical-optimizer/src/limit_pushdown.rs | 478 +--- datafusion/physical-optimizer/src/optimizer.rs | 108 +- .../physical-optimizer/src/output_requirements.rs | 68 +- .../physical-optimizer/src/projection_pushdown.rs | 61 + .../group_values/multi_group_by/bytes.rs | 19 +- .../group_values/multi_group_by/bytes_view.rs | 31 +- .../group_values/multi_group_by/primitive.rs | 21 +- .../physical-plan/src/coalesce_partitions.rs | 20 +- datafusion/physical-plan/src/common.rs | 3 + datafusion/physical-plan/src/execution_plan.rs | 54 +- datafusion/physical-plan/src/filter.rs | 65 +- datafusion/physical-plan/src/joins/cross_join.rs | 102 +- datafusion/physical-plan/src/joins/hash_join.rs | 57 +- .../physical-plan/src/joins/nested_loop_join.rs | 50 +- .../physical-plan/src/joins/sort_merge_join.rs | 89 +- .../physical-plan/src/joins/symmetric_hash_join.rs | 81 +- datafusion/physical-plan/src/joins/utils.rs | 1 + datafusion/physical-plan/src/memory.rs | 30 +- datafusion/physical-plan/src/projection.rs | 733 ++++- datafusion/physical-plan/src/repartition/mod.rs | 43 +- datafusion/physical-plan/src/sorts/sort.rs | 32 + .../src/sorts/sort_preserving_merge.rs | 37 +- datafusion/physical-plan/src/streaming.rs | 56 +- datafusion/physical-plan/src/union.rs | 32 + datafusion/physical-plan/src/unnest.rs | 34 +- datafusion/physical-plan/src/values.rs | 17 +- .../proto-common/proto/datafusion_common.proto | 1 + datafusion/proto-common/src/from_proto/mod.rs | 7 + datafusion/proto-common/src/generated/pbjson.rs | 18 + datafusion/proto-common/src/generated/prost.rs | 2 + datafusion/proto-common/src/to_proto/mod.rs | 3 + .../proto/src/generated/datafusion_proto_common.rs | 2 + datafusion/proto/src/logical_plan/file_formats.rs | 3 + datafusion/sql/src/unparser/dialect.rs | 38 +- datafusion/sql/src/unparser/expr.rs | 55 +- datafusion/sqllogictest/Cargo.toml | 2 +- datafusion/sqllogictest/bin/sqllogictests.rs | 95 +- .../src/engines/datafusion_engine/normalize.rs | 2 +- datafusion/sqllogictest/src/engines/mod.rs | 2 + datafusion/sqllogictest/src/lib.rs | 5 + datafusion/sqllogictest/src/util.rs | 108 + datafusion/sqllogictest/test_files/array.slt | 24 + datafusion/sqllogictest/test_files/ddl.slt | 1 - datafusion/sqllogictest/test_files/encoding.slt | 2 +- datafusion/sqllogictest/test_files/expr.slt | 2 +- .../sqllogictest/test_files/information_schema.slt | 2 +- .../test_files/{join.slt => join.slt.part} | 0 .../test_files/join_disable_repartition_joins.slt | 2 +- .../sqllogictest/test_files/join_only.slt | 6 +- datafusion/sqllogictest/test_files/joins.slt | 159 +- datafusion/sqllogictest/test_files/operator.slt | 250 ++ datafusion/sqllogictest/test_files/select.slt | 4 + datafusion/sqllogictest/test_files/subquery.slt | 2 +- .../sqllogictest/test_files/tpch/plans/q1.slt.part | 2 +- .../test_files/tpch/plans/q11.slt.part | 1 - .../test_files/tpch/plans/q16.slt.part | 1 - .../test_files/tpch/plans/q17.slt.part | 1 - .../test_files/tpch/plans/q20.slt.part | 1 - datafusion/sqllogictest/test_files/tpch/tpch.slt | 1 - datafusion/sqllogictest/test_files/window.slt | 2 +- docs/source/user-guide/configs.md | 2 +- docs/source/user-guide/introduction.md | 1 + 144 files changed, 8156 insertions(+), 5681 deletions(-) delete mode 100644 datafusion/core/src/physical_optimizer/mod.rs delete mode 100644 datafusion/core/src/physical_optimizer/optimizer.rs delete mode 100644 datafusion/core/src/physical_optimizer/projection_pushdown.rs create mode 100644 datafusion/core/tests/physical_optimizer/join_selection.rs create mode 100644 datafusion/core/tests/physical_optimizer/limit_pushdown.rs create mode 100644 datafusion/core/tests/physical_optimizer/projection_pushdown.rs rename datafusion/{physical-optimizer/src => core/tests/physical_optimizer}/test_utils.rs (94%) create mode 100644 datafusion/functions-aggregate/benches/array_agg.rs create mode 100644 datafusion/physical-optimizer/src/projection_pushdown.rs create mode 100644 datafusion/sqllogictest/src/util.rs rename datafusion/sqllogictest/test_files/{join.slt => join.slt.part} (100%) copy benchmarks/requirements.txt => datafusion/sqllogictest/test_files/join_only.slt (96%) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@datafusion.apache.org For additional commands, e-mail: commits-h...@datafusion.apache.org