pepijnve commented on PR #16196: URL: https://github.com/apache/datafusion/pull/16196#issuecomment-2929231158
> I remain unconvinced that modifying all operators is the right thing to do. I understand that sentiment. Definitely not ideal. Is there any property in the framework already that indicates how an operator will consume its children? If there's anything that indicates 'I will consume this child greedily/eagerly', and since the actual proposed implementation is a decorator, perhaps an optimizer rule could inject `YieldExec` nodes which create the decorator `YieldStream` instances. Alternatively, the same thing could be done on the leaf nodes. Not sure if it's a good idea to count on the presence of an optimizer rule for correctness though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
