Weijie Guo created FLINK-30902:
----------------------------------
Summary: Partition reuse does not take effect on edges of hybrid
selective type
Key: FLINK-30902
URL: https://issues.apache.org/jira/browse/FLINK-30902
Project: Flink
Issue Type: Bug
Components: Runtime / Coordination
Affects Versions: 1.17.0
Reporter: Weijie Guo
Assignee: Weijie Guo
Fix For: 1.17.0
Partition reuse only take effect for re-consumable edge, but hybrid selective
result partition is not re-consumable. This optimization is very important to
reduce the cost of the shuffle write phase. In the previous implementation, we
will only force the broadcast edge to be of hybrid full(re-consumable) in the
'ResultPartitionTypeFactory'. As a result, for ALL_ EXCHANGE_HYBRID_SELECTIVE
job, partition reuse cannot take effect for non-broadcast edges.
In fact, we expected to replace all the edges that can be reused with hybrid
full result partition.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
