This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/cargo/main/arrow-parquet-9e0b249e9c
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 02e1c720d9 chore(deps): bump the arrow-parquet group with 2 updates
add 424cf5afbb Restore lazy evaluation of fallible CASE (#15390)
add a4a1b081d2 chore(deps): bump log from 0.4.26 to 0.4.27 (#15410)
add 0b76ac89b5 chore(deps): bump chrono-tz from 0.10.2 to 0.10.3 (#15412)
add a0a063d235 Perf: Support Utf8View datatype single column comparisons
for SortPreservingMergeStream (#15348)
add 3e56ed2d96 Enforce JOIN plan to require condition (#15334)
add f3975da070 Fix type coercion for unsigned and signed integers (`Int64`
vs `UInt64`, etc) (#15341)
add 0a2e422411 simplify `array_has` UDF to `InList` expr when haystack is
constant (#15354)
add de8bcc536b Refactor: add `FileGroup` structure for
`Vec<PartitionedFile>` (#15379)
add e2e735430e [Minor] Remove/reorder logical plan rules (#15421)
add 923bfb7fc7 Improve performance of `first_value` by implementing
special `GroupsAccumulator` (#15266)
add 14beb79a21 Move `DataSink` to `datasource` and add session crate
(#15371)
add b2430117f1 refactor: SpillManager into a separate file (#15407)
add fd4346971a chore(deps): bump the arrow-parquet group with 2 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (02e1c720d9)
\
N -- N -- N
refs/heads/dependabot/cargo/main/arrow-parquet-9e0b249e9c (fd4346971a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 40 +-
Cargo.toml | 2 +
benchmarks/src/sort_tpch.rs | 8 +-
.../examples/parquet_exec_visitor.rs | 6 +-
datafusion/catalog-listing/Cargo.toml | 1 +
datafusion/catalog-listing/src/helpers.rs | 18 +-
datafusion/catalog/Cargo.toml | 2 +
datafusion/catalog/src/lib.rs | 30 +-
datafusion/catalog/src/stream.rs | 2 +-
datafusion/catalog/src/table.rs | 2 +-
datafusion/common/src/utils/mod.rs | 17 +
datafusion/core/Cargo.toml | 1 +
datafusion/core/benches/sort.rs | 111 ++-
datafusion/core/src/datasource/dynamic_file.rs | 10 +-
.../core/src/datasource/file_format/arrow.rs | 4 +-
datafusion/core/src/datasource/file_format/mod.rs | 3 +-
.../core/src/datasource/file_format/parquet.rs | 10 +-
datafusion/core/src/datasource/listing/table.rs | 11 +-
datafusion/core/src/datasource/memory.rs | 2 +-
datafusion/core/src/datasource/mod.rs | 1 +
.../src/datasource/physical_plan/arrow_file.rs | 4 +-
.../core/src/datasource/physical_plan/json.rs | 7 +-
.../core/src/datasource/physical_plan/mod.rs | 1 +
.../core/src/datasource/physical_plan/parquet.rs | 11 +-
datafusion/core/src/datasource/statistics.rs | 10 +-
datafusion/core/src/execution/context/mod.rs | 35 +-
datafusion/core/src/execution/session_state.rs | 5 +-
datafusion/core/src/lib.rs | 5 +
datafusion/core/src/physical_planner.rs | 3 +-
datafusion/core/src/test/mod.rs | 8 +-
datafusion/core/tests/fuzz_cases/aggregate_fuzz.rs | 27 +-
.../aggregation_fuzzer/data_generator.rs | 4 +
.../tests/fuzz_cases/aggregation_fuzzer/fuzzer.rs | 66 +-
.../physical_optimizer/enforce_distribution.rs | 9 +-
datafusion/datasource-avro/Cargo.toml | 1 +
datafusion/datasource-avro/src/file_format.rs | 16 +-
datafusion/datasource-csv/Cargo.toml | 1 +
datafusion/datasource-csv/src/file_format.rs | 12 +-
datafusion/datasource-csv/src/mod.rs | 7 +-
datafusion/datasource-csv/src/source.rs | 8 +-
datafusion/datasource-json/Cargo.toml | 1 +
datafusion/datasource-json/src/file_format.rs | 12 +-
datafusion/datasource-json/src/source.rs | 7 +-
datafusion/datasource-parquet/Cargo.toml | 1 +
datafusion/datasource-parquet/src/file_format.rs | 32 +-
datafusion/datasource-parquet/src/mod.rs | 6 +-
datafusion/datasource/Cargo.toml | 2 +-
datafusion/datasource/src/display.rs | 66 +-
datafusion/datasource/src/file_format.rs | 6 +-
datafusion/datasource/src/file_groups.rs | 342 +++++++---
datafusion/datasource/src/file_scan_config.rs | 35 +-
datafusion/datasource/src/file_sink_config.rs | 17 +-
datafusion/datasource/src/file_stream.rs | 4 +-
datafusion/datasource/src/mod.rs | 1 +
.../src/insert.rs => datasource/src/sink.rs} | 10 +-
datafusion/datasource/src/url.rs | 6 +-
datafusion/expr-common/src/type_coercion/binary.rs | 199 ++++--
datafusion/expr/src/logical_plan/builder.rs | 7 +-
datafusion/functions-aggregate/src/first_last.rs | 754 ++++++++++++++++++++-
datafusion/functions-nested/src/array_has.rs | 134 +++-
datafusion/optimizer/src/optimizer.rs | 4 +-
datafusion/optimizer/src/push_down_limit.rs | 174 +----
.../optimizer/src/scalar_subquery_to_join.rs | 18 +-
.../optimizer/src/single_distinct_to_groupby.rs | 8 +-
.../optimizer/tests/optimizer_integration.rs | 8 +-
datafusion/physical-expr/src/expressions/binary.rs | 6 +-
datafusion/physical-expr/src/expressions/case.rs | 34 +-
datafusion/physical-plan/src/lib.rs | 1 -
datafusion/physical-plan/src/sorts/cursor.rs | 57 +-
datafusion/physical-plan/src/sorts/sort.rs | 4 +-
.../physical-plan/src/sorts/streaming_merge.rs | 1 +
.../src/spill/in_progress_spill_file.rs | 92 +++
.../physical-plan/src/{spill.rs => spill/mod.rs} | 175 +----
.../physical-plan/src/spill/spill_manager.rs | 133 ++++
datafusion/proto/src/physical_plan/from_proto.rs | 27 +-
datafusion/proto/src/physical_plan/mod.rs | 47 +-
datafusion/proto/src/physical_plan/to_proto.rs | 4 +-
.../proto/tests/cases/roundtrip_physical_plan.rs | 33 +-
datafusion/{catalog => session}/Cargo.toml | 4 +-
.../{catalog-listing => session}/LICENSE.txt | 0
datafusion/{catalog-listing => session}/NOTICE.txt | 0
datafusion/{common => session}/README.md | 4 +-
datafusion/session/src/lib.rs | 39 ++
datafusion/{catalog => session}/src/session.rs | 6 +-
datafusion/sql/tests/cases/plan_to_sql.rs | 5 -
datafusion/sqllogictest/bin/sqllogictests.rs | 6 +
datafusion/sqllogictest/test_files/array.slt | 182 +++++
datafusion/sqllogictest/test_files/case.slt | 11 +
datafusion/sqllogictest/test_files/explain.slt | 8 +-
datafusion/sqllogictest/test_files/group_by.slt | 51 +-
datafusion/sqllogictest/test_files/join.slt.part | 22 +
datafusion/sqllogictest/test_files/math.slt | 10 +-
datafusion/sqllogictest/test_files/operator.slt | 8 +-
.../test_files/tpch/plans/q11.slt.part | 2 +-
.../test_files/tpch/plans/q15.slt.part | 2 +-
.../test_files/tpch/plans/q22.slt.part | 2 +-
datafusion/sqllogictest/test_files/window.slt | 8 +-
datafusion/substrait/src/physical_plan/consumer.rs | 4 +-
datafusion/substrait/src/physical_plan/producer.rs | 2 +-
.../tests/cases/roundtrip_physical_plan.rs | 10 +-
test-utils/Cargo.toml | 2 +-
101 files changed, 2512 insertions(+), 865 deletions(-)
rename datafusion/{physical-plan/src/insert.rs => datasource/src/sink.rs} (97%)
create mode 100644 datafusion/physical-plan/src/spill/in_progress_spill_file.rs
rename datafusion/physical-plan/src/{spill.rs => spill/mod.rs} (77%)
create mode 100644 datafusion/physical-plan/src/spill/spill_manager.rs
copy datafusion/{catalog => session}/Cargo.toml (96%)
copy datafusion/{catalog-listing => session}/LICENSE.txt (100%)
copy datafusion/{catalog-listing => session}/NOTICE.txt (100%)
copy datafusion/{common => session}/README.md (79%)
create mode 100644 datafusion/session/src/lib.rs
rename datafusion/{catalog => session}/src/session.rs (96%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
