This is an automated email from the ASF dual-hosted git repository.
yuanmei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from c8f27c25e87 [FLINK-34081][configuration] Refactor all callers of
deprecated `getXxx(ConfigOption<Xxx>)`, `getXxx(ConfigOption<Xxx>, Xxx)` and
`setXxx(ConfigOption<Integer>, Xxx)` methods of Configuration
add f9f9299f6e2 [FLINK-32073][checkpoint] Implement file merging in
snapshot
No new revisions were added by this update.
Summary of changes:
.../filemerging/FileMergingSnapshotManager.java | 24 +-
.../FileMergingSnapshotManagerBase.java | 76 ++++-
.../FileMergingSnapshotManagerBuilder.java | 2 +-
.../checkpoint/filemerging/LogicalFile.java | 12 +-
.../filemerging/SegmentFileStateHandle.java | 162 +++++++++
...WithinCheckpointFileMergingSnapshotManager.java | 2 +-
.../FileMergingCheckpointStateOutputStream.java | 259 ++++++++++++++
.../filesystem/FsCheckpointStorageAccess.java | 4 +-
.../FsMergingCheckpointStorageAccess.java | 45 ++-
.../FsMergingCheckpointStorageLocation.java | 105 ++++++
.../state/filesystem/FsSegmentDataInputStream.java | 126 +++++++
.../FileMergingSnapshotManagerTest.java | 112 ++++++-
.../state/TaskExecutorFileMergingManagerTest.java | 10 +-
...FileMergingCheckpointStateOutputStreamTest.java | 372 +++++++++++++++++++++
.../FsMergingCheckpointStorageLocationTest.java | 339 +++++++++++++++++++
.../filesystem/FsSegmentDataInputStreamTest.java | 128 +++++++
.../flink/streaming/runtime/tasks/StreamTask.java | 20 +-
.../tasks/SubtaskCheckpointCoordinatorImpl.java | 13 +
18 files changed, 1766 insertions(+), 45 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/filemerging/SegmentFileStateHandle.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FileMergingCheckpointStateOutputStream.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsMergingCheckpointStorageLocation.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsSegmentDataInputStream.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/state/filesystem/FileMergingCheckpointStateOutputStreamTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/state/filesystem/FsMergingCheckpointStorageLocationTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/state/filesystem/FsSegmentDataInputStreamTest.java
