Yingjie Cao created FLINK-25780: ----------------------------------- Summary: Reduce the maximum number of data output buffers for sort-shuffle Key: FLINK-25780 URL: https://issues.apache.org/jira/browse/FLINK-25780 Project: Flink Issue Type: Sub-task Components: Runtime / Network Reporter: Yingjie Cao Fix For: 1.15.0
The data output buffer of sort-shuffle is for better disk IO performance and currently, the total data output buffer size is 16M which is pretty big. However, blocking request too many buffers may influence performance. This ticket aims to reduce the maximum number of data output buffers to reduce the buffer request time. The selected value is an empirical one based on the TPC-DS test results. -- This message was sent by Atlassian Jira (v8.20.1#820001)