Ufuk Celebi created FLINK-1359: ---------------------------------- Summary: Make IntermediateResultPartitionManager aware of consumed partitions Key: FLINK-1359 URL: https://issues.apache.org/jira/browse/FLINK-1359 Project: Flink Issue Type: Improvement Components: Distributed Runtime Reporter: Ufuk Celebi Assignee: Ufuk Celebi
The current state of runtime support for intermediate results (see https://github.com/apache/incubator-flink/pull/254 and FLINK-986) does not distinguish between historic and currently produced/consumed intermediate result partitions (e.g. only non-persistent intermediate results) in the intermediate result partition manager. For persistent intermediate results we need to distinguish between currently consumed results and those that have already been produced and consumed. As a first step, historic results can be evicted based on least recent use. -- This message was sent by Atlassian JIRA (v6.3.4#6332)