[
https://issues.apache.org/jira/browse/FLINK-25780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yingjie Cao updated FLINK-25780:
--------------------------------
Summary: Reduce the maximum size of data output buffers per result
partition for sort-shuffle (was: Reduce the maximum number of data output
buffers per result partition for sort-shuffle)
> Reduce the maximum size of data output buffers per result partition for
> sort-shuffle
> ------------------------------------------------------------------------------------
>
> Key: FLINK-25780
> URL: https://issues.apache.org/jira/browse/FLINK-25780
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Network
> Reporter: Yingjie Cao
> Assignee: Yingjie Cao
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> The data output buffer of sort-shuffle is for better disk IO performance and
> currently, the total data output buffer size is 16M which is pretty big.
> However, blocking request too many buffers may influence performance. This
> ticket aims to reduce the maximum number of data output buffers to reduce the
> buffer request time. The selected value is an empirical one based on the
> TPC-DS test results.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
