[
https://issues.apache.org/jira/browse/FLINK-25774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482948#comment-17482948
]
Yun Gao commented on FLINK-25774:
---------------------------------
Fix on master via 13c8d4d4e5a210df63f08507d342bde57d32d690
> Restrict the maximum number of buffers can be used per result partition for
> sort-shuffle
> ----------------------------------------------------------------------------------------
>
> Key: FLINK-25774
> URL: https://issues.apache.org/jira/browse/FLINK-25774
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Network
> Reporter: Yingjie Cao
> Assignee: Yingjie Cao
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> Currently, for sort-shuffle, the maximum number of buffers can be used per
> result partition is Integer.MAX_VALUE. However, if too many buffers are taken
> by one result partition, other result partitions and input gates may spend
> too much time waiting for buffers which can influence performance. This
> ticket aims to restrict the maximum number of buffers can be used per result
> partition and the selected value is an empirical one based on the TPC-DS test
> results.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
