adriangb commented on PR #15301: URL: https://github.com/apache/datafusion/pull/15301#issuecomment-2735316127
Made a bit of progress on this... I think the general idea of sharing the state is there. The nice thing is that this mechanism can be used to push down other dynamic filters (joins, etc.). What I'm having trouble with a bit is the wiring... I need to think of: 1. How the optimizer traverses things, making sure to abort if it passes through any unsupported nodes. 2. How it recognizes that it's reached a DataSource. 3. How the DataSource gets modified (in place?) to register the dynamic filter source. Maybe that's the wrong approach... maybe this should be a method on `ExecutionPlan` that can recurse but by default is a no-op? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
