This is an automated email from the ASF dual-hosted git repository.
gaoyunhaii pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 08f98b7 [FLINK-23724][network] Fix the network buffer leak when
ResultPartition is released (#16844)
add c4e9a0b [hotfix][checkpoint] Extract CheckpointPlan to be an interface
add 191221c [hotfix][checkpoint] Refactor PendingCheckpoint to delegate
fulfill states to the CheckpointPlan
add 6d91d9c [FLINK-23512][checkpoint] Store whether a subtask is finished
in the checkpoint
add e933fa7 [FLINK-23512][runtime][checkpoint] Check illegal modification
when restoring from checkpoint with partly finished state
add 4987190 [hotfix][checkpoint] Add flag to skip the illegal jobgraph
check if not restore on startup
No new revisions were added by this update.
Summary of changes:
.../runtime/checkpoint/CheckpointCoordinator.java | 101 +-----
.../flink/runtime/checkpoint/CheckpointPlan.java | 73 +----
.../runtime/checkpoint/DefaultCheckpointPlan.java | 276 ++++++++++++++++
.../DefaultCheckpointPlanCalculator.java | 4 +-
.../checkpoint/FinishedOperatorSubtaskState.java | 41 +--
.../FinishedTaskStateProvider.java} | 28 +-
.../runtime/checkpoint/OperatorSubtaskState.java | 4 +
.../runtime/checkpoint/PendingCheckpoint.java | 179 +----------
.../checkpoint/StateAssignmentOperation.java | 4 +-
.../runtime/checkpoint/TaskStateAssignment.java | 6 +-
.../checkpoint/VertexFinishedStateChecker.java | 217 +++++++++++++
.../checkpoint/metadata/MetadataV3Serializer.java | 54 +++-
.../CheckpointCoordinatorRestoringTest.java | 200 +++++++++++-
.../CheckpointCoordinatorTestingUtils.java | 39 ++-
.../checkpoint/DefaultCheckpointPlanTest.java | 193 +++++++++++
.../runtime/checkpoint/PendingCheckpointTest.java | 353 +++++----------------
.../metadata/CheckpointMetadataTest.java | 2 +-
.../checkpoint/metadata/CheckpointTestUtils.java | 206 ++++++------
.../metadata/MetadataV3SerializerTest.java | 22 +-
19 files changed, 1247 insertions(+), 755 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/DefaultCheckpointPlan.java
copy
flink-connectors/flink-connector-elasticsearch-base/src/main/java/org/apache/flink/streaming/connectors/elasticsearch/table/IndexGeneratorBase.java
=>
flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/FinishedOperatorSubtaskState.java
(57%)
copy
flink-runtime/src/main/java/org/apache/flink/runtime/{jobgraph/DistributionPattern.java
=> checkpoint/FinishedTaskStateProvider.java} (55%)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/VertexFinishedStateChecker.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/DefaultCheckpointPlanTest.java
