Yuxin Tan created FLINK-32576: --------------------------------- Summary: ProducerMergedPartitionFileIndex supports spilling to file Key: FLINK-32576 URL: https://issues.apache.org/jira/browse/FLINK-32576 Project: Flink Issue Type: Bug Components: Runtime / Network Affects Versions: 1.18.0 Reporter: Yuxin Tan Assignee: Yuxin Tan
When running a very large-scale job, ProducerMergedPartitionFileIndex may occupy too much heap memory and cause OOM. To resolve the issue, ProducerMergedPartitionFileIndex should support spilling to file to release the occupied memory when necessary. -- This message was sent by Atlassian Jira (v8.20.10#820010)