zhijiangW commented on issue #11088: [FLINK-16012][runtime] Reduce the default number of buffers per channel from 2 to 1 URL: https://github.com/apache/flink/pull/11088#issuecomment-587352777 Yes, I executed the micro-benchmark on our benchmarking machine yesterday and almost all the tests for network throughput has a bit regression except the data skew case. I confirmed with @wsry to also verify the results for only reducing the receiver side, keeping the buffer same as before on sender side. And the results still have a bit regression, but better than reducing both receiver and sender sides. Next step we can further test how many buffers are really needed for both output and input sides in different scales, without regression. Then we can decide how to tune this setting, based on job scale or dynamic option.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
