This is an automated email from the ASF dual-hosted git repository.
zhuzh pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 35ac5e5 [hotfix][connector][jdbc] Corrected exception variable name
(#16662)
new 81e1db3 [FLINK-23214][runtime] Make ShuffleMaster a cluster level
shared service
new 6bc8399 [FLINK-22674][runtime] Provide JobID when applying for
shuffle resources by ShuffleMaster#registerPartitionWithProducer
new 0ee4038 [FLINK-23249][runtime] Introduce ShuffleMasterContext to
ShuffleMaster
new 80df36b [FLINK-22675][runtime] Add lifecycle methods to ShuffleMaster
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../JobMasterServiceLeadershipRunnerFactory.java | 7 -
.../flink/runtime/executiongraph/Execution.java | 3 +-
.../io/network/NettyShuffleServiceFactory.java | 6 +-
.../partition/JobMasterPartitionTracker.java | 13 +-
.../partition/JobMasterPartitionTrackerImpl.java | 13 +-
.../jobmaster/JobManagerSharedServices.java | 31 ++-
.../apache/flink/runtime/jobmaster/JobMaster.java | 19 ++
.../flink/runtime/jobmaster/JobMasterGateway.java | 8 +
.../factories/DefaultJobMasterServiceFactory.java | 3 +-
.../flink/runtime/shuffle/JobShuffleContext.java} | 25 +-
.../JobShuffleContextImpl.java} | 29 ++-
.../flink/runtime/shuffle/NettyShuffleMaster.java | 5 +-
.../flink/runtime/shuffle/ShuffleMaster.java | 40 +++-
.../runtime/shuffle/ShuffleMasterContext.java} | 17 +-
.../runtime/shuffle/ShuffleMasterContextImpl.java | 40 ++--
.../runtime/shuffle/ShuffleServiceFactory.java | 5 +-
.../runtime/deployment/ShuffleDescriptorTest.java | 12 +-
.../ExecutionPartitionLifecycleTest.java | 4 +-
.../JobMasterPartitionTrackerImplTest.java | 4 +-
.../partition/NoOpJobMasterPartitionTracker.java | 2 +-
.../TestingJobMasterPartitionTracker.java | 3 +-
.../TestingJobManagerSharedServicesBuilder.java | 12 +-
.../jobmaster/utils/TestingJobMasterGateway.java | 6 +
.../SsgNetworkMemoryCalculationUtilsTest.java | 5 +-
.../flink/runtime/shuffle/ShuffleMasterTest.java | 251 +++++++++++++++++++++
.../runtime/shuffle/ShuffleServiceLoaderTest.java | 3 +-
.../runtime/shuffle/TestingShuffleMaster.java | 5 +-
27 files changed, 481 insertions(+), 90 deletions(-)
copy
flink-runtime/src/{test/java/org/apache/flink/runtime/taskexecutor/NoOpPartitionProducerStateChecker.java
=> main/java/org/apache/flink/runtime/shuffle/JobShuffleContext.java} (59%)
copy
flink-runtime/src/main/java/org/apache/flink/runtime/{taskexecutor/rpc/RpcPartitionStateChecker.java
=> shuffle/JobShuffleContextImpl.java} (59%)
copy
flink-runtime/src/{test/java/org/apache/flink/runtime/shuffle/ShuffleTestUtils.java
=> main/java/org/apache/flink/runtime/shuffle/ShuffleMasterContext.java} (61%)
copy
flink-connectors/flink-connector-base/src/test/java/org/apache/flink/connector/base/source/reader/mocks/TestingSourceSplit.java
=>
flink-runtime/src/main/java/org/apache/flink/runtime/shuffle/ShuffleMasterContextImpl.java
(53%)
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/shuffle/ShuffleMasterTest.java