This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from 5edda9b309 fix: calculate total seconds from interval fields for
`extract(epoch)` (#19807)
add ca904b3086 Row group limit pruning for row groups that entirely match
predicates (#18868)
No new revisions were added by this update.
Summary of changes:
datafusion/core/tests/parquet/mod.rs | 105 +++++--
datafusion/core/tests/parquet/row_group_pruning.rs | 339 ++++++++++++++++++++-
datafusion/datasource-parquet/src/metrics.rs | 12 +-
datafusion/datasource-parquet/src/opener.rs | 17 +-
.../datasource-parquet/src/row_group_filter.rs | 219 ++++++++++++-
datafusion/datasource-parquet/src/source.rs | 1 +
datafusion/datasource/src/file_scan_config.rs | 34 +++
datafusion/datasource/src/source.rs | 17 ++
.../optimizer/src/optimize_projections/mod.rs | 13 +-
.../physical-expr-common/src/metrics/value.rs | 40 ++-
.../physical-optimizer/src/enforce_sorting/mod.rs | 10 +-
.../physical-optimizer/src/limit_pushdown.rs | 27 +-
.../physical-plan/src/coalesce_partitions.rs | 13 +
datafusion/physical-plan/src/execution_plan.rs | 13 +
datafusion/physical-plan/src/filter.rs | 13 +
datafusion/physical-plan/src/limit.rs | 29 ++
datafusion/physical-plan/src/projection.rs | 13 +
.../src/sorts/sort_preserving_merge.rs | 13 +
datafusion/pruning/src/pruning_predicate.rs | 1 -
.../sqllogictest/test_files/limit_pruning.slt | 81 +++++
docs/source/user-guide/explain-usage.md | 1 +
21 files changed, 958 insertions(+), 53 deletions(-)
create mode 100644 datafusion/sqllogictest/test_files/limit_pruning.slt
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
