JanKaul commented on PR #21425: URL: https://github.com/apache/datafusion/pull/21425#issuecomment-4389715221
Hey, thank you guys for working on this. To make the discussion more concrete I created a complementary PR https://github.com/apache/datafusion/pull/22043 that uses an async "try_grow_async" method, similar to @2010YOUY01 's proposal, such that consumers can wait until a reclaimer was able to return some memory. The reclaimer uses a channel to signal a selected operator to spill. The operator runs a state machine and when instructed to spill, does so before continuing the execution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
