[
https://issues.apache.org/jira/browse/FLINK-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743104#comment-14743104
]
ASF GitHub Bot commented on FLINK-2641:
---------------------------------------
GitHub user mxm opened a pull request:
https://github.com/apache/flink/pull/1125
[FLINK-2641] integrate off-heap memory configuration
- remove taskmanager.heap.mb and jobmanager.heap.mb
- introduce taskmanager.memory.size and jobmanger.memory.size
which allow to control total combined heap and off-heap memory
- add offheap configuration parameter taskmanager.memory.off-heap
- remove offheap ratio parameter and reuse memory fraction parameter
- rename taskmanager.memory.fraction to taskmanager.memory.managed.fraction
- rename taskmanager.memory.size to taskmanager.memory.managed.size
- set JVM -XX:MaxDirectMemorySize parameter correctly
- remove number of network buffers config entry
- allow configuration of network memory size via new entry
taskmanager.memory.network.size
- adapt code and tests to changes
- remove deprecated ConfigConstants.TASK_MANAGER_MEMORY_SEGMENT_SIZE_KEY
- fail when obsolete config entries are detected
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mxm/flink off_heap_config
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/1125.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1125
----
commit 05e737034019b2edbb33f9372ba8389589f87eb4
Author: Maximilian Michels <[email protected]>
Date: 2015-09-11T14:07:22Z
[FLINK-2641] integrate off-heap memory configuration
- remove taskmanager.heap.mb and jobmanager.heap.mb
- introduce taskmanager.memory.size and jobmanger.memory.size
which allow to control total combined heap and off-heap memory
- add offheap configuration parameter taskmanager.memory.off-heap
- remove offheap ratio parameter and reuse memory fraction parameter
- rename taskmanager.memory.fraction to taskmanager.memory.managed.fraction
- rename taskmanager.memory.size to taskmanager.memory.managed.size
- set JVM -XX:MaxDirectMemorySize parameter correctly
- remove number of network buffers config entry
- allow configuration of network memory size via new entry
taskmanager.memory.network.size
- adapt code and tests to changes
- remove deprecated ConfigConstants.TASK_MANAGER_MEMORY_SEGMENT_SIZE_KEY
- fail when obsolete config entries are detected
----
> Integrate the off-heap memory configuration with the TaskManager start script
> -----------------------------------------------------------------------------
>
> Key: FLINK-2641
> URL: https://issues.apache.org/jira/browse/FLINK-2641
> Project: Flink
> Issue Type: New Feature
> Components: Start-Stop Scripts
> Affects Versions: 0.10
> Reporter: Stephan Ewen
> Assignee: Maximilian Michels
> Fix For: 0.10
>
>
> The TaskManager start script needs to adjust the {{-Xmx}}, {{-Xms}}, and
> {{-XX:MaxDirectMemorySize}} parameters according to the off-heap memory
> settings.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
