GitHub user mxm opened a pull request:
https://github.com/apache/flink/pull/1125
[FLINK-2641] integrate off-heap memory configuration
- remove taskmanager.heap.mb and jobmanager.heap.mb
- introduce taskmanager.memory.size and jobmanger.memory.size
which allow to control total combined heap and off-heap memory
- add offheap configuration parameter taskmanager.memory.off-heap
- remove offheap ratio parameter and reuse memory fraction parameter
- rename taskmanager.memory.fraction to taskmanager.memory.managed.fraction
- rename taskmanager.memory.size to taskmanager.memory.managed.size
- set JVM -XX:MaxDirectMemorySize parameter correctly
- remove number of network buffers config entry
- allow configuration of network memory size via new entry
taskmanager.memory.network.size
- adapt code and tests to changes
- remove deprecated ConfigConstants.TASK_MANAGER_MEMORY_SEGMENT_SIZE_KEY
- fail when obsolete config entries are detected
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/flink off_heap_config
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1125.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1125
----
commit 05e737034019b2edbb33f9372ba8389589f87eb4
Author: Maximilian Michels <[email protected]>
Date: 2015-09-11T14:07:22Z
[FLINK-2641] integrate off-heap memory configuration
- remove taskmanager.heap.mb and jobmanager.heap.mb
- introduce taskmanager.memory.size and jobmanger.memory.size
which allow to control total combined heap and off-heap memory
- add offheap configuration parameter taskmanager.memory.off-heap
- remove offheap ratio parameter and reuse memory fraction parameter
- rename taskmanager.memory.fraction to taskmanager.memory.managed.fraction
- rename taskmanager.memory.size to taskmanager.memory.managed.size
- set JVM -XX:MaxDirectMemorySize parameter correctly
- remove number of network buffers config entry
- allow configuration of network memory size via new entry
taskmanager.memory.network.size
- adapt code and tests to changes
- remove deprecated ConfigConstants.TASK_MANAGER_MEMORY_SEGMENT_SIZE_KEY
- fail when obsolete config entries are detected
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
