This is an automated email from the ASF dual-hosted git repository.
fanrui pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from fa8ea3f9a44 [FLINK-18286] Implement type inference for functions on
composite types
new 64992471c5d [FLINK-33354][runtime][refactor] Refactor
ShuffleDescriptorsCache into a generic GroupCache
new d237ed64476 [FLINK-33354][runtime][refactor] serializedJobInformation
and taskInfo are never null
new b1786ba952b [FLINK-33354][runtime] Cache TaskInformation and
JobInformation to avoid deserializing duplicate big objects
new b759794e33d [FLINK-33354][runtime] Using the InputStream instead of
byte array to avoid contiguous huge memory usage
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../deployment/InputGateDeploymentDescriptor.java | 9 +-
.../deployment/TaskDeploymentDescriptor.java | 111 ++++++++------
.../runtime/executiongraph/JobInformation.java | 59 ++++++--
.../runtime/executiongraph/TaskInformation.java | 40 +++++
.../DefaultShuffleDescriptorsCache.java | 153 -------------------
.../taskexecutor/ShuffleDescriptorsCache.java | 54 -------
.../flink/runtime/taskexecutor/TaskExecutor.java | 29 ++--
.../runtime/taskexecutor/TaskManagerServices.java | 40 ++++-
.../flink/runtime/util/DefaultGroupCache.java | 163 +++++++++++++++++++++
.../org/apache/flink/runtime/util/GroupCache.java | 35 +++--
.../deployment/TaskDeploymentDescriptorTest.java | 139 ++++++++++++++----
.../flink/runtime/dispatcher/JobMasterTester.java | 4 +-
.../DefaultExecutionGraphDeploymentTest.java | 13 +-
...hDeploymentWithSmallBlobCacheSizeLimitTest.java | 7 +-
.../taskexecutor/NoOpShuffleDescriptorsCache.java | 44 ------
.../taskexecutor/TaskManagerServicesBuilder.java | 5 +-
.../DefaultGroupCacheTest.java} | 45 +++---
.../apache/flink/runtime/util/NoOpGroupCache.java} | 18 ++-
18 files changed, 566 insertions(+), 402 deletions(-)
delete mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/DefaultShuffleDescriptorsCache.java
delete mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/ShuffleDescriptorsCache.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/util/DefaultGroupCache.java
copy
flink-table/flink-table-common/src/main/java/org/apache/flink/table/data/utils/CastExecutor.java
=> flink-runtime/src/main/java/org/apache/flink/runtime/util/GroupCache.java
(56%)
delete mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/taskexecutor/NoOpShuffleDescriptorsCache.java
rename
flink-runtime/src/test/java/org/apache/flink/runtime/{taskexecutor/DefaultShuffleDescriptorsCacheTest.java
=> util/DefaultGroupCacheTest.java} (76%)
copy
flink-runtime/src/{main/java/org/apache/flink/runtime/util/KeyGroupedIterator.java
=> test/java/org/apache/flink/runtime/util/NoOpGroupCache.java} (70%)
