alamb commented on issue #3941: URL: https://github.com/apache/arrow-datafusion/issues/3941#issuecomment-1291869970
> de-couple try_grow and spill, removing async from try_grow, do manual spill in case of failure. I think decoupling try_grow and spill would be my preference. In general, if memory is exceeded we may not actually want to spill for all operators (e.g. an initial hash table might simply flush its output if it exceeded memory rather than trying to spill) cc @yjshen in case he has some additional thoughts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
