This is an automated email from the ASF dual-hosted git repository.
pnowojski pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 4698edb [FLINK-22382][tests] Harden
ProcessFailureCancelingITCase.testCancelingOnProcessFailure
new 088d165 [FLINK-23453][refactor] Made a safe method for getting the
number of buffers in the queue visible in the interface.
new fd66a8c [FLINK-23453][core] Added the rest configuration for
buffer-debloater
new a36fac6 [FLINK-23453][runtime] Message for notification about new
buffer size(NewBufferSize) was added
new b92fa30 [FLINK-23453][runtime] Prepared Gates and Channels classes
for either providing information for the calculation of buffer size and
receiving the recalculated buffer size.
new 9158fc76 [FLINK-23453][streaming] Created the buffer debloater for the
ability to automatically change the buffer size based on the throughput.
new 3b7e227 [FLINK-23453][streaming] Integration BufferDebloater to
StreamTask
new d8477bd [FLINK-23453][core] Renaming configuration
automatic-buffer-adjustment -> buffer-debloat
The 7 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../generated/all_taskmanager_network_section.html | 28 +++-
.../generated/all_taskmanager_section.html | 6 +
.../generated/task_manager_configuration.html | 28 +++-
.../task_manager_memory_configuration.html | 6 +
.../flink/configuration/TaskManagerOptions.java | 55 ++++++-
.../runtime/io/network/NetworkClientHandler.java | 8 +
.../runtime/io/network/PartitionRequestClient.java | 8 +
.../CreditBasedPartitionRequestClientHandler.java | 25 ++++
.../runtime/io/network/netty/NettyMessage.java | 49 +++++++
.../network/netty/NettyPartitionRequestClient.java | 5 +
.../netty/PartitionRequestServerHandler.java | 4 +
.../partition/BoundedBlockingSubpartition.java | 5 +
...edBlockingSubpartitionDirectTransferReader.java | 5 +
.../BoundedBlockingSubpartitionReader.java | 5 +
.../partition/NoOpResultSubpartitionView.java | 5 +
.../network/partition/PipelinedSubpartition.java | 7 +-
.../partition/PipelinedSubpartitionView.java | 5 +
.../io/network/partition/ResultSubpartition.java | 3 +
.../network/partition/ResultSubpartitionView.java | 2 +
.../partition/SortMergeSubpartitionReader.java | 7 +
.../network/partition/consumer/BufferManager.java | 6 +
.../partition/consumer/IndexedInputGate.java | 4 +
.../network/partition/consumer/InputChannel.java | 4 +
.../partition/consumer/LocalInputChannel.java | 10 ++
.../partition/consumer/RecoveredInputChannel.java | 12 ++
.../partition/consumer/RemoteInputChannel.java | 22 +++
.../partition/consumer/SingleInputGate.java | 16 ++
.../partition/consumer/UnknownInputChannel.java | 10 ++
.../runtime/taskmanager/InputGateWithMetrics.java | 10 ++
.../org/apache/flink/runtime/taskmanager/Task.java | 5 +-
.../runtime/throughput/ThroughputCalculator.java | 5 +-
.../io/network/TestingPartitionRequestClient.java | 3 +
.../network/netty/CancelPartitionRequestTest.java | 5 +
...editBasedPartitionRequestClientHandlerTest.java | 51 ++++++-
.../NettyMessageServerSideSerializationTest.java | 11 ++
.../network/partition/InputGateFairnessTest.java | 4 +-
.../partition/PipelinedSubpartitionTest.java | 18 +++
.../io/network/partition/ResultPartitionTest.java | 4 +-
.../partition/consumer/InputChannelTest.java | 8 +
.../partition/consumer/RemoteInputChannelTest.java | 30 ++++
.../partition/consumer/TestInputChannel.java | 16 ++
.../flink/streaming/runtime/tasks/StreamTask.java | 30 +++-
.../tasks/bufferdebloat/BufferDebloater.java | 99 +++++++++++++
.../streaming/runtime/io/MockIndexedInputGate.java | 8 +
.../flink/streaming/runtime/io/MockInputGate.java | 8 +
.../AlignedCheckpointsMassiveRandomTest.java | 8 +
.../streaming/runtime/tasks/StreamTaskTest.java | 66 ++++++++-
.../tasks/bufferdebloat/BufferDebloaterTest.java | 163 +++++++++++++++++++++
.../streaming/util/TestStreamEnvironment.java | 6 +
pom.xml | 1 +
50 files changed, 868 insertions(+), 41 deletions(-)
create mode 100644
flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/bufferdebloat/BufferDebloater.java
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/tasks/bufferdebloat/BufferDebloaterTest.java
