This is an automated email from the ASF dual-hosted git repository.
wjones127 pushed a change to branch fsl-scalar-support
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
discard 5e8d7844d2 feat: support eq_array and to_array_of_size for FSL
omit 4b2d1066f2 feat: make FSL scalar also an arrayref
add 6ecb6cd78d Preserve all of the valid orderings during merging. (#8169)
add 7f11125744 Make fields of `ScalarUDF` , `AggregateUDF` and `WindowUDF`
non `pub` (#8079)
add 849d85f566 Fix logical conflicts (#8187)
add 77a63260d1 Minor: Update JoinHashMap example to make it clearer (#8154)
add 020b8fc761 Implement StreamTable and StreamTableProvider (#7994)
(#8021)
add 67d66faa82 Remove unused Results (#8189)
add 841a9a6e41 Minor: clean up the code based on clippy (#8179)
add e1c2f95830 Minor: simplify filter statistics code (#8174)
add 7c2c2f0297 Replace macro with function for `array_position` and
`array_positions` (#8170)
add cd1c648e71 Add Library Guide for User Defined Functions:
Window/Aggregate (#8171)
add a1c96634bd Add more stream docs (#8192)
add 6b945a4409 Implement func `array_pop_front` (#8142)
add 937bb44fd0 Moving arrow_files SQL tests to sqllogictest (#8217)
add 04c77ca3ec fix use of name in Column (#8219)
add 4c6f5c5310 Fix column indices in the planning tests (#8191)
add 37eecfe6ef Remove unnecessary reassignment (#8232)
add 9fd0f4e3f8 Update itertools requirement from 0.11 to 0.12 (#8233)
add b126bca13c Port tests in subqueries.rs to sqllogictest (#8231)
add b013087b50 feat: make FSL scalar also an arrayref (#8221)
add f9159eada4 feat: support eq_array and to_array_of_size for FSL
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5e8d7844d2)
\
N -- N -- N refs/heads/fsl-scalar-support (f9159eada4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
Cargo.toml | 2 +-
datafusion-cli/Cargo.lock | 73 +++--
datafusion-examples/examples/simple_udaf.rs | 4 +
datafusion-examples/examples/simple_udwf.rs | 4 +-
datafusion/core/src/datasource/listing/helpers.rs | 2 +-
datafusion/core/src/datasource/listing/table.rs | 37 +--
.../core/src/datasource/listing_table_factory.rs | 9 +-
datafusion/core/src/datasource/mod.rs | 44 +++
datafusion/core/src/datasource/provider.rs | 40 +++
datafusion/core/src/datasource/stream.rs | 341 +++++++++++++++++++
datafusion/core/src/execution/context/mod.rs | 20 +-
.../src/physical_optimizer/enforce_distribution.rs | 10 +-
.../core/src/physical_optimizer/join_selection.rs | 1 +
.../src/physical_optimizer/projection_pushdown.rs | 8 +-
.../replace_with_order_preserving_variants.rs | 185 ++++++-----
datafusion/core/src/physical_planner.rs | 13 +-
datafusion/core/tests/fifo.rs | 226 ++++++-------
.../fuzz_cases/sort_preserving_repartition_fuzz.rs | 277 +++++++++++++++-
datafusion/core/tests/sql/arrow_files.rs | 70 ----
datafusion/core/tests/sql/mod.rs | 2 -
datafusion/core/tests/sql/subqueries.rs | 63 ----
datafusion/expr/src/built_in_function.rs | 6 +
datafusion/expr/src/expr.rs | 14 +-
datafusion/expr/src/expr_fn.rs | 8 +
datafusion/expr/src/expr_schema.rs | 4 +-
datafusion/expr/src/udaf.rs | 47 ++-
datafusion/expr/src/udf.rs | 50 ++-
datafusion/expr/src/udwf.rs | 44 ++-
datafusion/expr/src/window_function.rs | 12 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 4 +-
datafusion/optimizer/src/push_down_projection.rs | 27 +-
.../src/simplify_expressions/expr_simplifier.rs | 2 +-
datafusion/physical-expr/Cargo.toml | 2 +-
datafusion/physical-expr/src/array_expressions.rs | 359 ++++++++++++---------
datafusion/physical-expr/src/equivalence.rs | 31 +-
datafusion/physical-expr/src/functions.rs | 5 +-
datafusion/physical-expr/src/scalar_function.rs | 6 +-
datafusion/physical-expr/src/udf.rs | 6 +-
datafusion/physical-plan/Cargo.toml | 2 +-
datafusion/physical-plan/src/aggregates/mod.rs | 10 +-
datafusion/physical-plan/src/filter.rs | 12 +-
datafusion/physical-plan/src/joins/hash_join.rs | 6 +-
.../physical-plan/src/joins/hash_join_utils.rs | 55 ++--
datafusion/physical-plan/src/repartition/mod.rs | 3 -
.../src/sorts/sort_preserving_merge.rs | 3 +-
datafusion/physical-plan/src/streaming.rs | 21 +-
datafusion/physical-plan/src/udaf.rs | 10 +-
datafusion/physical-plan/src/windows/mod.rs | 26 +-
datafusion/proto/proto/datafusion.proto | 1 +
datafusion/proto/src/generated/pbjson.rs | 3 +
datafusion/proto/src/generated/prost.rs | 3 +
datafusion/proto/src/logical_plan/from_proto.rs | 6 +-
datafusion/proto/src/logical_plan/to_proto.rs | 9 +-
datafusion/proto/src/physical_plan/from_proto.rs | 7 +-
datafusion/proto/src/physical_plan/to_proto.rs | 3 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 12 +-
.../proto/tests/cases/roundtrip_physical_plan.rs | 4 +-
datafusion/sql/src/select.rs | 6 +-
datafusion/sqllogictest/test_files/array.slt | 50 ++-
.../test_files/{map.slt => arrow_files.slt} | 48 ++-
datafusion/sqllogictest/test_files/ddl.slt | 2 +-
datafusion/sqllogictest/test_files/groupby.slt | 10 +-
datafusion/sqllogictest/test_files/subquery.slt | 24 ++
datafusion/sqllogictest/test_files/window.slt | 57 +++-
datafusion/substrait/src/logical_plan/producer.rs | 2 +-
docs/source/library-user-guide/adding-udfs.md | 316 +++++++++++++++++-
docs/source/user-guide/expressions.md | 1 +
docs/source/user-guide/sql/scalar_functions.md | 25 ++
68 files changed, 1984 insertions(+), 811 deletions(-)
create mode 100644 datafusion/core/src/datasource/stream.rs
delete mode 100644 datafusion/core/tests/sql/arrow_files.rs
delete mode 100644 datafusion/core/tests/sql/subqueries.rs
copy datafusion/sqllogictest/test_files/{map.slt => arrow_files.slt} (61%)
