getniz commented on issue #2201: URL: https://github.com/apache/hudi/issues/2201#issuecomment-720538496
thanks @n3nash @tooptoop4 for your explanation. Yes, this is what I'm looking for but the tricky part is we wouldn't know when the delete will happen; anyways irrespective of delete ops if I take snapshot of the hudi dataset periodically then I can rely to go back in time queries as you mentioned above. Also, one final query - Is there any limit to the number of versions I can retain using the version retain policy (or) there is no limit at all. In my scenario I'm planning to retain monthly one version for 8 years. (8x12=96 versions)? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
