vinothchandar commented on pull request #2342: URL: https://github.com/apache/hudi/pull/2342#issuecomment-750473227
>Regarding this scenario, my thoughts would be to check rollback metadata only against unsynced instants, i.e. if any instants after C8 were considered in rollback. To be clear, we want to skip syncing a rollback instant to metadata table, if the instant it rolled back is not in completed state on the unsynced portion of the data timeline.? Thats what I meant by `(we could compare the latest instant on metadata timeline C8 and assume its applied?)`. I think it will work out fine. Let's implement this? >Say metadata timeline has been synced up to C2, but data timeline archival has happened to C8. We have code to guard against this already. Data timeline archiving won't move past latest instant on metadata timeline https://github.com/apache/hudi/blob/f7f8c33f804b1bb2cfecf3ac18edc9eb584c679e/hudi-client/src/main/java/org/apache/hudi/table/HoodieTimelineArchiveLog.java#L203 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
