This is an automated email from the ASF dual-hosted git repository.
wanglijie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from c0044be734a [FLINK-32608][table-planner] Support scan reusing with
projection pushdown
add fa4518960fd [FLINK-32385][runtime] Introduce ShuffleDescriptorGroup to
identify a group of ShuffleDescriptorAndIndex
add 4d642635c94 [FLINK-32386][runtime] Introduce ShuffleDescriptorsCache
to cache ShuffleDescriptorGroup
add 7a9efbff0a2 [FLINK-32387][runtime] InputGateDeploymentDescriptor uses
cache to avoid deserializing shuffle descriptors multiple times
No new revisions were added by this update.
Summary of changes:
.../deployment/CachedShuffleDescriptors.java | 21 +--
.../deployment/InputGateDeploymentDescriptor.java | 129 +++++++++++------
.../deployment/TaskDeploymentDescriptor.java | 14 +-
.../TaskDeploymentDescriptorFactory.java | 49 ++++---
.../runtime/executiongraph/IntermediateResult.java | 6 +-
.../DefaultShuffleDescriptorsCache.java | 153 ++++++++++++++++++++
.../taskexecutor/ShuffleDescriptorsCache.java | 54 +++++++
.../flink/runtime/taskexecutor/TaskExecutor.java | 11 +-
.../runtime/taskexecutor/TaskManagerServices.java | 15 +-
.../deployment/CachedShuffleDescriptorsTest.java | 33 +++--
.../TaskDeploymentDescriptorFactoryTest.java | 20 +--
.../TaskDeploymentDescriptorTestUtils.java | 28 ++--
.../DefaultExecutionGraphDeploymentTest.java | 4 +-
...hDeploymentWithSmallBlobCacheSizeLimitTest.java | 4 +-
.../RemoveCachedShuffleDescriptorTest.java | 12 +-
.../partition/consumer/SingleInputGateTest.java | 4 +-
.../DefaultShuffleDescriptorsCacheTest.java | 159 +++++++++++++++++++++
...ecker.java => NoOpShuffleDescriptorsCache.java} | 23 +--
.../taskexecutor/TaskManagerServicesBuilder.java | 3 +-
19 files changed, 603 insertions(+), 139 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/DefaultShuffleDescriptorsCache.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/ShuffleDescriptorsCache.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/taskexecutor/DefaultShuffleDescriptorsCacheTest.java
copy
flink-runtime/src/test/java/org/apache/flink/runtime/taskexecutor/{NoOpPartitionProducerStateChecker.java
=> NoOpShuffleDescriptorsCache.java} (57%)
