klion26 opened a new pull request #8751: [FLINK-11937][StateBackend]Resolve small file problem in RocksDB incremental checkpoint URL: https://github.com/apache/flink/pull/8751 ## What is the purpose of the change This pr wants to fix the problem of too many small files in RocksDB incremental checkpoint. - commit 7aa56f5 introduces some components to support this feature - commit f2e8b43 modified some exist components to support this feature(one file for one checkpoint)and add some tests to verify this. ## Brief change log This pr introduces some necessary classes, such as - FsSegmentCheckpointStorage - FsCheckpointStreamFactory - FsSegmentCheckpointStorageLocation - FsSegmentCheckpointStreamFactory - FsSegmentStateBackend - FsSegmentStateHandle This pr modifies some exist classes to support this feature, such as: - SharedStateRegistry - RocksDBStateBackend and add some tests to verify the correct. ## Verifying this change This pr introduces some test and modified some exist test to verify the changes. - SharedStateRegistryTest - RocksDBStateBackendTest - FsSegmentCheckpointStorageTest - FsSegmentCheckpointStorageTest.java - FsSegmentStateBackendEntropyTest.java - FsSegmentStateHandleTest.java - RocksDBSegmentStateBackendFactoryTest.java - SavepointV2SerializerTest.java ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (**no**) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (**no**) - The serializers: (**no**) - The runtime per-record code paths (performance sensitive): (**no**) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (**yes**) - The S3 file system connector: (**no**) ## Documentation - Does this pull request introduce a new feature? (**yes**) - If yes, how is the feature documented? (**JavaDocs**)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
