n3nash edited a comment on issue #2951: URL: https://github.com/apache/hudi/issues/2951#issuecomment-841981356
@ChandraNarreddy Yes, Hudi can perform incremental queries based on just 1 snapshot. Incremental queries check if there are any new commits from the last checkpoint passed from user, if yes, it will get the latest snapshot of the record. hoodie.cleaner.commits.retained -> This config is a rolling window. If you set this to let's say 10, Hudi will keep all versions (including latest) of files until 10 commits, on the 11th commit, the oldest file version belonging to the 1st commit will be deleted. hoodie.cleaner.fileversions.retained -> Like the name suggests, this will retain the number of file versions forever. Let me know if you have any further questions. @pratyakshsharma a blog on this will be very helpful soon.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
