Ufuk Celebi created FLINK-1359:
----------------------------------

             Summary: Make IntermediateResultPartitionManager aware of consumed 
partitions
                 Key: FLINK-1359
                 URL: https://issues.apache.org/jira/browse/FLINK-1359
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi


The current state of runtime support for intermediate results (see 
https://github.com/apache/incubator-flink/pull/254 and FLINK-986) does not 
distinguish between historic and currently produced/consumed intermediate 
result partitions (e.g. only non-persistent intermediate results) in the 
intermediate result partition manager.

For persistent intermediate results we need to distinguish between currently 
consumed results and those that have already been produced and consumed. As a 
first step, historic results can be evicted based on least recent use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to