Zhu Zhu created FLINK-15037:

             Summary: Introduce LimittingMemoryManager as operator scope 
                 Key: FLINK-15037
                 URL: https://issues.apache.org/jira/browse/FLINK-15037
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.10.0
            Reporter: Zhu Zhu

Current {{MemoryManager}} is slot scope component, and the operators needs to 
use a fraction to compute memory size/pages it can allocate and use it to 
reserver memory or allocate pages.
This, however, requires operators to be aware of the managed memory fraction. 
There is also risk that one operator may over allocate resources than it has 
declared and causes other operators to break.

To separate concerns, we can introduce a {{LimittingMemoryManager}} which wraps 
the the original MemoryManager but limit the available memory size to the 
fraction of total memory governed by the original one. This wrapper would be a 
operator scope {{MemoryManager}}.

cc [~azagrebin]

This message was sent by Atlassian Jira

Reply via email to