This is an automated email from the ASF dual-hosted git repository.
srichter pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from 7adeecd3445 [FLINK-34510][Runtime/State]Rename RestoreMode to
RecoveryClaimMode (#25192)
new c11632674a8 [FLINK-35580] Prevent potential JVM crashes from async
compaction when RocksDB is already closed.
new a0ace618ad1 [FLINK-35580] Register async compact task with the
backend's lifecycle instead of the restore lifecycle.
new 9b2b922a159 [FLINK-35580] Introduce artificial map key for
RegisteredStateMetaInfoBase for safe deduplication in
RocksDBIncrementalRestoreOperation.
new 9ba7e670512 [FLINK-35580] Handle async compaction exceptions in
RocksDB restore.
new deeb42ec897 [FLINK-35580] Improve logging and problem analysis in
RockDBHandle.
new 42757607f23 [FLINK-35580] Fix synchronization issue when closing
RocksDBWriteBatchWrapper
new 830a17155cf [FLINK-35580] Ensure RocksDB working directory is created
before opening DB.
new 95ef07b789b [FLINK-35580] Improve logging for IngestDB to make key
range checks more observable.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../apache/flink/core/fs/ICloseableRegistry.java | 15 --
.../state/CompositeKeySerializationUtils.java | 12 ++
.../runtime/state/RegisteredStateMetaInfoBase.java | 46 +++++
.../state/EmbeddedRocksDBStateBackend.java | 4 +-
.../state/RocksDBIncrementalCheckpointUtils.java | 222 ++++++++++++++------
.../streaming/state/RocksDBKeyedStateBackend.java | 8 +-
.../state/RocksDBKeyedStateBackendBuilder.java | 37 +++-
.../streaming/state/RocksDBOperationUtils.java | 26 ++-
.../streaming/state/RocksDBWriteBatchWrapper.java | 58 ++++++
.../state/restore/RocksDBFullRestoreOperation.java | 4 +-
.../streaming/state/restore/RocksDBHandle.java | 11 +-
.../RocksDBHeapTimersFullRestoreOperation.java | 4 +-
.../RocksDBIncrementalRestoreOperation.java | 229 ++++++++++++---------
.../state/restore/RocksDBRestoreResult.java | 11 +-
.../streaming/state/RocksDBRecoveryTest.java | 47 ++++-
.../contrib/streaming/state/RocksDBTestUtils.java | 2 +-
.../state/RocksDBWriteBatchWrapperTest.java | 57 +++++
17 files changed, 576 insertions(+), 217 deletions(-)
