crepererum commented on PR #4820: URL: https://github.com/apache/arrow-datafusion/pull/4820#issuecomment-1373368182
> Maybe it is worth reviewing this code and ensuring it only buffers inputs when one of the outputs is empty and was polled. 🤔 I can try that in a follow up. In general unbounded buffering cannot be avoided though since the output may poll partition 1 while the input only produced data for partition 2 til the very end. We can make buffering less likely though (hence let's try this in a follow up). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
