LiaCastaneda commented on issue #22758: URL: https://github.com/apache/datafusion/issues/22758#issuecomment-4967588150
> which means that having one operator spill that batch may not free the memory. 🤔 Isn't that technically correct though? If another operator still holds the shared buffer it genuinely needs it in memory, so a spill by one of the holders shouldn't free it -- it drops only when no one references it. I would assume this happens with or without the arrow memory pool. Or is the pool making this worse somehow? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
