This is an automated email from the ASF dual-hosted git repository.
guoweijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from 8f4409e717c [FLINK-32407][table] Notify catalog modification listener
for table ddl in CatalogManager (#23041)
add c9e18336426 [FLINK-31643][network] Implement the
TieredStorageConfiguration and enable TieredResultPartition
add afaa6c2f5aa [FLINK-31643][network] Restrict the min number of required
buffers per result partition in tiered storage
add 48d4d5ccd8d [FLINK-31643][network] Restrict the max number of required
buffers per input gate in tiered storage
No new revisions were added by this update.
Summary of changes:
.../generated/all_taskmanager_network_section.html | 16 +-
.../netty_shuffle_environment_configuration.html | 16 +-
.../NettyShuffleEnvironmentOptions.java | 48 ++-
.../io/network/NettyShuffleEnvironment.java | 10 +-
.../io/network/NettyShuffleServiceFactory.java | 27 +-
.../network/partition/ResultPartitionFactory.java | 69 +++-
.../partition/consumer/InputGateSpecUtils.java | 11 +-
.../partition/consumer/SingleInputGateFactory.java | 21 +-
.../tiered/common/TieredStorageConfiguration.java | 423 +++++++++++++++++++--
.../shuffle/TieredInternalShuffleMaster.java | 5 +-
.../tiered/shuffle/TieredResultPartition.java | 15 +-
.../shuffle/TieredResultPartitionFactory.java | 215 +++++++++++
.../flink/runtime/shuffle/NettyShuffleMaster.java | 21 +-
.../flink/runtime/shuffle/NettyShuffleUtils.java | 17 +-
.../NettyShuffleEnvironmentConfiguration.java | 17 +-
.../network/partition/ResultPartitionBuilder.java | 13 +-
.../partition/ResultPartitionFactoryTest.java | 85 ++++-
.../partition/consumer/GateBuffersSpecTest.java | 53 ++-
.../partition/consumer/SingleInputGateTest.java | 4 +-
.../tiered/shuffle/TieredResultPartitionTest.java | 29 +-
.../benchmark/SingleInputGateBenchmarkFactory.java | 1 +
.../StreamNetworkBenchmarkEnvironment.java | 3 +-
.../flink/test/runtime/HybridShuffleITCase.java | 9 +
23 files changed, 1018 insertions(+), 110 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/tiered/shuffle/TieredResultPartitionFactory.java
