This is an automated email from the ASF dual-hosted git repository.
alamb pushed a change to branch string-view2
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from ab8005d8d5 Implement native support StringView for character length
(#11676)
add 204e1bcbaa Use `AccumulatorArgs::is_reversed` in `NthValueAgg` (#11669)
add 42732b5f40 Docs: adding explicit mention of test_utils to docs (#11670)
add a598739ad7 Ensure statistic defaults in parquet writers are in sync
(#11656)
add 3cfb99d987 Implement physical plan serialization for json Copy plans
(#11645)
add a721be1b1d Minor: improve documentation on SessionState (#11642)
add 5ad60678a2 Add LimitPushdown optimization rule and CoalesceBatchesExec
fetch (#11652)
add 823a007577 Update to arrow/parquet `52.2.0` (#11691)
add 561aee8aed Merge remote-tracking branch 'apache/main' into string-view2
add 2e9c8a0099 Remove uneeded patches
No new revisions were added by this update.
Summary of changes:
Cargo.toml | 34 +-
datafusion-cli/Cargo.lock | 89 +--
datafusion-cli/Cargo.toml | 18 +-
datafusion/common/src/config.rs | 2 +-
.../common/src/file_options/parquet_writer.rs | 118 +---
datafusion/core/src/datasource/file_format/json.rs | 3 +-
.../src/datasource/physical_plan/arrow_file.rs | 13 +
.../core/src/datasource/physical_plan/avro.rs | 13 +
.../core/src/datasource/physical_plan/csv.rs | 18 +
.../core/src/datasource/physical_plan/json.rs | 12 +
.../src/datasource/physical_plan/parquet/mod.rs | 18 +
datafusion/core/src/execution/session_state.rs | 19 +-
.../core/src/physical_optimizer/limit_pushdown.rs | 662 +++++++++++++++++++++
datafusion/core/src/physical_optimizer/mod.rs | 1 +
.../core/src/physical_optimizer/optimizer.rs | 5 +
datafusion/core/tests/memory_limit/mod.rs | 23 +-
datafusion/execution/src/task.rs | 6 +-
datafusion/functions-aggregate/src/nth_value.rs | 18 +-
datafusion/optimizer/src/push_down_limit.rs | 37 +-
.../physical-expr-common/src/aggregate/mod.rs | 2 +-
datafusion/physical-plan/src/coalesce_batches.rs | 186 +++++-
.../physical-plan/src/coalesce_partitions.rs | 4 +
datafusion/physical-plan/src/lib.rs | 16 +
datafusion/physical-plan/src/projection.rs | 4 +
datafusion/physical-plan/src/sorts/sort.rs | 11 +
.../src/sorts/sort_preserving_merge.rs | 4 +
datafusion/physical-plan/src/streaming.rs | 13 +
.../proto-common/proto/datafusion_common.proto | 5 +
datafusion/proto-common/src/generated/pbjson.rs | 91 +++
datafusion/proto-common/src/generated/prost.rs | 6 +
datafusion/proto/proto/datafusion.proto | 1 +
.../proto/src/generated/datafusion_proto_common.rs | 6 +
datafusion/proto/src/generated/pbjson.rs | 13 +
datafusion/proto/src/generated/prost.rs | 4 +-
datafusion/proto/src/lib.rs | 2 +-
datafusion/proto/src/logical_plan/file_formats.rs | 69 ++-
datafusion/proto/src/logical_plan/mod.rs | 25 +-
.../proto/tests/cases/roundtrip_logical_plan.rs | 84 ++-
datafusion/sqllogictest/test_files/explain.slt | 36 +-
datafusion/sqllogictest/test_files/group_by.slt | 18 +-
.../sqllogictest/test_files/information_schema.slt | 4 +-
.../test_files/join_disable_repartition_joins.slt | 4 +-
datafusion/sqllogictest/test_files/limit.slt | 6 +-
datafusion/sqllogictest/test_files/order.slt | 10 +-
datafusion/sqllogictest/test_files/repartition.slt | 2 +-
datafusion/sqllogictest/test_files/select.slt | 4 +-
datafusion/sqllogictest/test_files/topk.slt | 5 +-
.../sqllogictest/test_files/tpch/q11.slt.part | 105 ++--
datafusion/sqllogictest/test_files/union.slt | 19 +-
datafusion/sqllogictest/test_files/window.slt | 238 ++++----
docs/source/contributor-guide/testing.md | 1 +
docs/source/user-guide/configs.md | 2 +-
52 files changed, 1610 insertions(+), 499 deletions(-)
create mode 100644 datafusion/core/src/physical_optimizer/limit_pushdown.rs
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
