adriangb commented on PR #15770: URL: https://github.com/apache/datafusion/pull/15770#issuecomment-2857400638
Curious to see what you come up with! A couple of ideas: 1. Split filter pushdown into two phases. One that can modify the plan structure but not push down filters with references to nodes (so just pushing static FilterExec filters down) and another that pushes down dynamic filters but cannot modify the shape of the plan. 2. Have an extra pass that specifically deals with removing redundant CoalesceBatchesExec & RepartitionExec. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
