adriangb commented on issue #17334: URL: https://github.com/apache/datafusion/issues/17334#issuecomment-3477746243
My thought was that when a spillable operator request to reserve memory it can provide how much space it could possibly spill if required and the MemoryPool responds with how much memory it can give the operator or how much it wants it to spill. Initially we could implement it as `spill_or_reserve = (soft_limit - (current + request))` or something like that so if it's negative the operator is not only being denied it's memory request but it's also being asked to spill some spillable memory it had already been granted to free it up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
