alamb commented on issue #6179: URL: https://github.com/apache/arrow-datafusion/issues/6179#issuecomment-1875226373
I was thinking about this last night and it seems to me that [PruningPredicate](https://docs.rs/datafusion/latest/datafusion/physical_optimizer/pruning/struct.PruningPredicate.html#) does exactly this type of simplification for predicates, based on additional information that might be available (such as null counts, and statistics). It happens using physical expressions (not just logical expressions) so it is too late in the planning process to affect the logical plan 🤔 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
