n3nash commented on issue #2951: URL: https://github.com/apache/hudi/issues/2951#issuecomment-841981356
@ChandraNarreddy Yes, Hudi can perform incremental queries based on just 1 snapshot. Incremental queries check if there are any new commits from the last checkpoint passed from user, if yes, it will get the latest snapshot of the record. hoodie.cleaner.commits.retained -> This config is a rolling window. If you set this to let's say 10, Hudi will keep all versions (including latest) of files until 10 commits, on the 11th commit, the oldest file version belonging to the 1st commit will be deleted. hoodie.cleaner.fileversions.retained -> Like the name suggests, this will retain the number of file versions forever. @pratyakshsharma a blog on this will be very helpful soon.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
