zhijiangW commented on issue #11088: [FLINK-16012][runtime] Reduce the default number of buffers per channel from 2 to 1 URL: https://github.com/apache/flink/pull/11088#issuecomment-591834461 Thanks for the updates @wsry ! If we only adjust the exclusive buffer from 2 to 1 on receiver side, and still keep 2 on sender side, then the micro-benchmark has no regressions. We could further verify it in cluster jobs because the network transport delay might behave different with micro-benchmark. If the conclusion is the same, then I think it is reasonable to make this change for receiver side. We can save 25% in-flight buffers almost. But we might need to introduce another buffer setting parameter which would break the compatibility. Regarding the upstream side, I guess it might not be feasible to give a static buffer setting when setup. And it is more likely with the data distribution among subpartitions. The hash partitioner might have the similar behavior with rebalance partitioner in practice. And we can further consider the dynamic way on sender side in another ticket.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
