rmpifer commented on pull request #2342: URL: https://github.com/apache/hudi/pull/2342#issuecomment-750456129
> ``` > data timeline : C1, rollback C12, rollback C11, ..... rollback C2 > metadata timeline: C3, ..., C8 > ``` > > It's now hard to determine whether or not `rollback C2` should be applied. (we could compare the latest instant on metadata timeline C8 and assume its applied?) Regarding this scenario, my thoughts would be to check rollback metadata only against unsynced instants, so only after C8. Is this potentially surfacing a more general issue though. Say metadata timeline has been synced up to C2, but data timeline archival has happened to C8. It seems next time we try to find unsynced instants we won't consider anything between C2...C8 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
