qq619618919 commented on pull request #13680: URL: https://github.com/apache/pulsar/pull/13680#issuecomment-1015469266
Changes: 1. Add compactedTopic offload code in CompactorSubscription. If the topic is successfully compacted to bookkeeper, it will continue to check whether there is an offload ledger on this topic. If there is, it will offload the compacted topic ledger data from bookkeeper to tiered storage, and save the uuid of the successful offload attempt to MetaStore. 2. Change LedgerHandle in CompactedTopicContext to ReadHandle of it‘s super interface, which ensures that bookkeeper and tiered storage share ReadHandle. And add ReadHandle to read data related logic. 3. Add an OffloadCompactedTopicImpl class that extends CompactedTopicImpl, Indicates that the CompactedTopic is in the offload state. If you need to read data from OffloadCompactedTopicImpl, it will use the ReadHandle of tiered storage to read. At the same time, when the topic is initialized, the attributes of the compaction subscription metadata will be detected. If there is an offloaded uuid, the OffloadCompactedTopicImpl will be constructed, which ensures that the data can still be read from the tiered storage. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
