voonhous commented on PR #20451: URL: https://github.com/apache/hudi/pull/20451#issuecomment-6635377192
Gonna merge this in. I don't see a better alternative since our MDT is always built with the latest snapshot and there's no robust versioning in MDT. So, TLDR, MDT reads always see the latest state, and there's no as-of read today. To achieve this feature, it's quite challenging imo, DT cleaning needs to be sync with MDT compaction/cleaning. So if cleaner config says we keep last N commits, (i.e. we can time travel to any of the N commits), MDT cleaning will also need to keep N commits worth of changes. This is not possible today. Given there's no better alternative -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
