suibianwanwank commented on issue #8777: URL: https://github.com/apache/datafusion/issues/8777#issuecomment-3904440991
> Yes. Just restating the deadlock concern from the issue description. I generated this diagram to show the problem - if the probe side buffer is full, the "FanoutExec" is back-pressured. We end up blocking the build side from completing and deadlock. I agree with your point. I actually tried to implement this approach before, but this issue blocked me. The fundamental difference from repartition is that the consumers are not stateless — there may be various forms of dependencies between them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
