This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch alamb/array_crate
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
omit a07d74b2b3 cargo doc
omit a2ea70388d tomlfmt
omit bad11dc64b Update datafusion-cli Cargo.lock
omit 36caded5e2 fix title
omit cc325e6095 Add `datafusion-functions-array` crate
omit 4257c16d8e Add `FunctionRegistry::register_udaf` and
`FunctionRegistry::register_udwf`
add 1f70823cfc Update minimum rust version to 1.72 (#8997)
add 402625f035 . (#9099)
add a9fda5eb91 Update InfluxDB links in Known Users (#9092)
add 038763c7db Support `FixedSizeList` type coercion (#8902)
add e566329707 Improve Canonicalize API (#8983)
add 968c05f1c0 Update env_logger requirement from 0.10 to 0.11 (#8944)
add 8b50774d6a Split count_distinct.rs into separate modules (#9087)
add a6ef1bec48 Fix update_expr for projection pushdown (#9096)
add f203d863f5 Improve `InListSImplifier` -- add test, commend and avoid
clones (#8971)
add 7641a32281 feat: issue #8969 adding position function (#8988)
add 9d1502bce0 Cleanup regex_expressions.rs to remove _regexp_match
function (#9107)
add 24197d706e Unnest with single expression (#9069)
add f5302ef392 Minor: improve GroupsAccumulator and Accumulator
documentation (#8963)
add 5f18aa7e85 move InList related simplify to one place (#9037)
add 86a2ab0885 docs: add docs and example showing how to get the
expression data type (#9118)
add 840499fbd3 Add http(s) support to the command line (#8753)
add e61c71d6a7 Remove External Table Backwards Compatibility Options
(#9105)
add 195f8256ce feat: support `LargeList` in `flatten` (#9110)
add afb5d5bcb7 improve make_date benchmark (#9112)
add 35f481dbcc Refactor min/max value update in Parquet statistics (#9120)
add aef28ae0bd chore:rename DataFrame to LogicalPlan (#9123)
add 33b52ba455 Minor: Fix Self referential links in readme (#9119)
add dfb6435e16 Add `ColumnarValue::values_to_arrays`, deprecate
`columnar_values_to_array` (#9114)
add c43c5f14e4 Support Copy with Remote Object Stores in datafusion-cli
(#9064)
add d1aca48b5e Fix Dockerfile min rust version to 1.72 (#9135)
add 9669520bbd fix: schema metadata retrieval when listing parquet table
(#9134)
add 2b6ca7be5a Update parse_protobuf_file_scan_config to remove any
partition columns from the file_schema in FileScanConfig (#9126)
add d4426567da feat: add github action to self-assign the issue (#9132)
add 55720a42e5 Fix NULL values in FixedSizeList creation (#9141)
add 77f97756c5 Add `FunctionRegistry::register_udaf` and
`FunctionRegistry::register_udwf` (#9075)
add 8413da8803 Change ScalarValue::Struct to ArrayRef (#7893)
add 1089df9335 Add `datafusion-functions-array` crate
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (a07d74b2b3)
\
N -- N -- N refs/heads/alamb/array_crate (1089df9335)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/rust.yml | 6 +-
.github/workflows/take.yml | 41 ++
Cargo.toml | 5 +-
benchmarks/Cargo.toml | 2 +-
datafusion-cli/Cargo.lock | 68 +-
datafusion-cli/Cargo.toml | 5 +-
datafusion-cli/Dockerfile | 2 +-
datafusion-cli/src/exec.rs | 124 +++-
datafusion-cli/src/object_storage.rs | 45 +-
datafusion-examples/examples/expr_api.rs | 46 ++
datafusion-examples/examples/simple_udf.rs | 4 +-
datafusion/common/src/scalar.rs | 746 ++++++++++++++-------
datafusion/common/src/utils.rs | 54 +-
datafusion/core/Cargo.toml | 5 +-
datafusion/core/README.md | 11 +-
.../core/src/datasource/file_format/parquet.rs | 194 ++----
datafusion/core/src/datasource/listing/helpers.rs | 1 +
datafusion/core/src/datasource/listing/table.rs | 2 +-
.../core/src/datasource/listing_table_factory.rs | 10 +-
datafusion/core/src/execution/context/mod.rs | 8 +-
.../src/physical_optimizer/projection_pushdown.rs | 16 +-
datafusion/core/src/physical_planner.rs | 13 +-
datafusion/core/tests/parquet/schema.rs | 17 +-
.../tests/user_defined/user_defined_aggregates.rs | 29 +-
datafusion/execution/src/registry.rs | 2 +-
datafusion/expr/src/accumulator.rs | 11 +-
datafusion/expr/src/built_in_function.rs | 57 +-
datafusion/expr/src/columnar_value.rs | 133 +++-
datafusion/expr/src/expr.rs | 24 +-
datafusion/expr/src/expr_rewriter/mod.rs | 12 +-
datafusion/expr/src/expr_schema.rs | 35 +-
datafusion/expr/src/groups_accumulator.rs | 18 +-
datafusion/expr/src/signature.rs | 57 +-
datafusion/expr/src/tree_node/expr.rs | 6 +-
datafusion/expr/src/type_coercion/functions.rs | 62 +-
datafusion/expr/src/udaf.rs | 13 +-
datafusion/expr/src/utils.rs | 3 +-
datafusion/optimizer/Cargo.toml | 2 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 4 +-
datafusion/optimizer/src/push_down_filter.rs | 1 +
.../src/simplify_expressions/expr_simplifier.rs | 179 +++--
.../src/simplify_expressions/inlist_simplifier.rs | 308 +++++++--
.../optimizer/src/simplify_expressions/mod.rs | 1 -
.../simplify_expressions/or_in_list_simplifier.rs | 100 ---
.../src/simplify_expressions/simplify_exprs.rs | 55 +-
datafusion/physical-expr/Cargo.toml | 1 +
.../src/aggregate/array_agg_distinct.rs | 28 +-
.../src/aggregate/array_agg_ordered.rs | 80 ++-
.../src/aggregate/count_distinct/mod.rs | 257 ++-----
.../src/aggregate/count_distinct/native.rs | 215 ++++++
.../src/aggregate/count_distinct/strings.rs | 6 +-
.../physical-expr/src/aggregate/hyperloglog.rs | 8 +-
.../physical-expr/src/aggregate/nth_value.rs | 53 +-
datafusion/physical-expr/src/array_expressions.rs | 52 +-
.../physical-expr/src/datetime_expressions.rs | 92 ++-
datafusion/physical-expr/src/regex_expressions.rs | 97 +--
datafusion/physical-plan/src/filter.rs | 2 +-
datafusion/proto/Cargo.toml | 5 +-
datafusion/proto/gen/Cargo.toml | 2 +-
datafusion/proto/proto/datafusion.proto | 25 +-
datafusion/proto/src/generated/pbjson.rs | 257 ++++---
datafusion/proto/src/generated/prost.rs | 36 +-
datafusion/proto/src/logical_plan/from_proto.rs | 45 +-
datafusion/proto/src/logical_plan/to_proto.rs | 65 +-
datafusion/proto/src/physical_plan/from_proto.rs | 16 +-
datafusion/proto/src/physical_plan/to_proto.rs | 13 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 70 +-
.../proto/tests/cases/roundtrip_physical_plan.rs | 30 +-
datafusion/sql/src/expr/function.rs | 54 +-
datafusion/sql/src/expr/mod.rs | 19 +-
datafusion/sql/src/select.rs | 41 +-
datafusion/sqllogictest/test_files/array.slt | 644 +++++++++++++++++-
.../sqllogictest/test_files/arrow_typeof.slt | 2 +-
datafusion/sqllogictest/test_files/explain.slt | 12 +
.../sqllogictest/test_files/insert_to_external.slt | 95 +--
datafusion/sqllogictest/test_files/join.slt | 41 +-
.../test_files/{cast.slt => position.slt} | 41 +-
datafusion/sqllogictest/test_files/unnest.slt | 97 +++
datafusion/substrait/Cargo.toml | 3 +-
datafusion/substrait/src/logical_plan/consumer.rs | 2 +-
datafusion/wasmtest/Cargo.toml | 2 +-
docs/Cargo.toml | 2 +-
docs/source/contributor-guide/index.md | 8 +
.../library-user-guide/working-with-exprs.md | 28 +
docs/source/user-guide/cli.md | 21 +
docs/source/user-guide/introduction.md | 2 +-
docs/source/user-guide/sql/scalar_functions.md | 14 +
test-utils/Cargo.toml | 2 +-
88 files changed, 3350 insertions(+), 1772 deletions(-)
create mode 100644 .github/workflows/take.yml
delete mode 100644
datafusion/optimizer/src/simplify_expressions/or_in_list_simplifier.rs
create mode 100644
datafusion/physical-expr/src/aggregate/count_distinct/native.rs
copy datafusion/sqllogictest/test_files/{cast.slt => position.slt} (66%)
create mode 100644 datafusion/sqllogictest/test_files/unnest.slt
