alamb opened a new pull request, #4280: URL: https://github.com/apache/arrow-datafusion/pull/4280
# Which issue does this PR close? Draft as it builds on https://github.com/apache/arrow-datafusion/pull/4278 re https://github.com/apache/arrow-datafusion/issues/4020 # Rationale for this change If a predicate can't be turned into a pruning predicate, it is converted to "true" and will not prune anything. However, the parquet exec will still attempt to read and create statistics in this case which is wasteful (as nothing can be pruned) After https://github.com/apache/arrow-datafusion/pull/4278 it is also confusing to see `pruning_predicate=true` in the explain plan # What changes are included in this PR? 1. Check for, and ignore pruning predicates that are always true # Are these changes tested? Yes # Are there any user-facing changes? <!-- If there are user-facing changes then we may require documentation to be updated before approving the PR. --> <!-- If there are any breaking changes to public APIs, please add the `api change` label. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
