NicoK commented on a change in pull request #7687: [FLINK-11542][config][docs]
Extend memory configuration descriptions
URL: https://github.com/apache/flink/pull/7687#discussion_r259571290
##########
File path: docs/ops/config.md
##########
@@ -70,6 +70,12 @@ These parameters configure the default HDFS used by Flink.
Setups that do not sp
{% include generated/task_manager_configuration.html %}
+By default, Flink allocates a fraction of 0.7 of the free memory (total memory
configured via taskmanager.heap.mb minus memory used for network buffers) for
its managed memory. Managed memory helps Flink to run the batch operators
efficiently. It prevents OutOfMemoryExceptions because Flink knows how much
memory it can use to execute operations. If Flink runs out of managed memory,
it utilizes disk space. Using managed memory, some operations can be performed
directly on the raw data without having to deserialize the data to convert it
into Java objects. All in all, managed memory improves the robustness and speed
of the system.
Review comment:
Maybe, after mentioning that this helps with batch operators, mention that
it is (currently) not used for streaming jobs?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services