This is an automated email from the ASF dual-hosted git repository.
xtsong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from d8417565d6f [FLINK-28526][python] Fix Python UDF to support time
indicator inputs
new fc7defb14d1 [FLINK-30471][network] Optimize the enriching network
memory process in SsgNetworkMemoryCalculationUtils
new afdf4a73e43 [FLINK-30472][network] Modify the default value of the max
network memory config option
new ae8de97ef2a [FLINK-30473][network] Optimize the InputGate network
memory management for TaskManager
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../generated/all_taskmanager_network_section.html | 6 +
.../generated/common_memory_section.html | 4 +-
.../netty_shuffle_environment_configuration.html | 6 +
.../task_manager_memory_configuration.html | 4 +-
.../NettyShuffleEnvironmentOptions.java | 29 +++
.../flink/configuration/TaskManagerOptions.java | 6 +-
.../partition/consumer/GateBuffersSpec.java | 61 +++++++
.../partition/consumer/InputGateSpecUitls.java | 125 +++++++++++++
.../partition/consumer/SingleInputGateFactory.java | 45 +++--
.../SsgNetworkMemoryCalculationUtils.java | 99 +++++-----
.../flink/runtime/shuffle/NettyShuffleMaster.java | 35 +++-
.../flink/runtime/shuffle/NettyShuffleUtils.java | 52 ++++--
.../shuffle/TaskInputsOutputsDescriptor.java | 29 ++-
.../NettyShuffleEnvironmentConfiguration.java | 29 +++
.../io/network/NettyShuffleEnvironmentBuilder.java | 10 ++
.../partition/consumer/GateBuffersSpecTest.java | 200 +++++++++++++++++++++
.../partition/consumer/SingleInputGateBuilder.java | 4 +-
.../partition/consumer/SingleInputGateTest.java | 63 +++++++
.../SsgNetworkMemoryCalculationUtilsTest.java | 13 +-
.../runtime/shuffle/NettyShuffleUtilsTest.java | 16 +-
.../benchmark/SingleInputGateBenchmarkFactory.java | 3 +-
21 files changed, 746 insertions(+), 93 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/GateBuffersSpec.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/InputGateSpecUitls.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/consumer/GateBuffersSpecTest.java