Yingjie Cao created FLINK-29299:
-----------------------------------
Summary: Fix the network memory size calculation issue in
fine-grained resource mode
Key: FLINK-29299
URL: https://issues.apache.org/jira/browse/FLINK-29299
Project: Flink
Issue Type: Improvement
Components: Runtime / Network
Affects Versions: 1.16.0
Reporter: Yingjie Cao
Fix For: 1.16.0
After FLINK-28663, one intermediate dataset can be consumed by multiple
consumers, there is a case where one vertex can consume one intermediate
dataset multiple times. However, currently in fine-grained resource mode, when
computing the required network buffer size, the intermediate dataset is used as
key to record the size of network buffer per input gate, which means it may
allocate less network buffers than needed if two input gate of the same vertex
consumes the same intermediate dataset.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
