hequn8128 commented on a change in pull request #10453: [FLINK-14026][python]
Manage the resource of Python worker properly
URL: https://github.com/apache/flink/pull/10453#discussion_r354692393
##########
File path: docs/_includes/generated/python_configuration.html
##########
@@ -20,5 +26,11 @@
<td>Long</td>
<td>Sets the waiting timeout(in milliseconds) before processing a
bundle for Python user-defined function execution. The timeout defines how long
the elements of a bundle will be buffered before being processed. Lower
timeouts lead to lower tail latencies, but may affect throughput.</td>
</tr>
+ <tr>
+ <td><h5>python.fn-execution.framework.memory.size</h5></td>
+ <td style="word-wrap: break-word;">"64mb"</td>
+ <td>String</td>
+ <td>The amount of memory to be allocated by the Python framework.
The memory will be accounted as managed memory. The sum of the value of this
configuration and "python.fn-execution.buffer.memory.size" represents the total
memory of the Python worker.</td>
Review comment:
Maybe also add a notice that the configured total memory will not take
effect if it exceeds the available managed off-heap?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services