adriangb commented on issue #20324: URL: https://github.com/apache/datafusion/issues/20324#issuecomment-3904432303
> Thinking more about this, I wonder if we could model the choice of where to evaluate a filter as a dynamic filter 🤔 > > Aka make two filters for each predicate > > * The one in the parquet reader > * The one in a subsequent FilterExec > > And then have the pair somehow coordiante between themselves during execution to decide which to evaluate 🤔 > > Though maybe that would be too localized (should take multiple predicates into account) That is kind of what is happening with the current approach I am exploring, but I think doing it all in the scan nodes is a bit tidier and will allow us to do more sophisticated things -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
