darmie commented on issue #20324: URL: https://github.com/apache/datafusion/issues/20324#issuecomment-3917751164
@adriangb I have tightened the guard in [#20417 ](https://github.com/apache/datafusion/pull/20417, the batch filter path now only triggers when the predicate has a single *static* conjunct with all columns in the projection. Multi-conjunct static predicates (like your `WHERE id = 123 AND long_message LIKE '%foo%'` example) stay on the RowFilter path for incremental evaluation. Dynamic filter conjuncts (from TopK / join pushdown) are excluded from the count since they reference the same projected columns and don't benefit from RowFilter's incremental decode skipping. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
