edmondop commented on issue #23194: URL: https://github.com/apache/datafusion/issues/23194#issuecomment-5936343425
I have a small PR (#25798) proposing the stage-boundary interface as a first, standalone piece: an execution-plan capability to prime input partitions, observe when each has completed, and release output. It includes a test/example implementation and examples for deterministic pause/resume and caller-controlled stage admission. It does not add AQE orchestration, runtime optimizer rules, or statistics. I’m sharing it here because it may be a useful core seam for the broader directions in this issue. Feedback on whether this interface belongs in core—and whether its per-partition readiness/release contract is the right scope—would be appreciated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
