zhijiangW commented on issue #11088: [FLINK-16012][runtime] Reduce the default number of buffers per channel from 2 to 1 URL: https://github.com/apache/flink/pull/11088#issuecomment-608314828 > we might prefer in the end to just advertise two main different setups: full throughput with 2 exclusive buffers and low throughput with 1/0 exclusive buffers. Anything in between would be for power users to self tune? Agree, i think it is the right way to go. After we solve the deadlock issue for 0 exclusive buffers on receiver side, we can accept any settings by users and only give some explanations how different setting would impact the performance. Adjust the default floating buffers might not make sense ATM, because we do not fully know yet how many floating buffers are really needed for different scale and partitioner mode to not impact performance. I guess finally we still need a separate exclusive buffer configuration for receiver side different with sender side. Then users can tune exclusive buffer as 0 for receiver side separately, but keep at-least 1 exclusive buffer for sender side. Even the default exclusive buffer for receiver can be adjusted as 1 instead of 2, as we already verified it would not impact performance.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
