nsivabalan commented on issue #6527: URL: https://github.com/apache/hudi/issues/6527#issuecomment-1233256049
oh, just now looking at your solution. it might have some corner cases. For eg, if you choose cleaner policy to be LATEST_FILE_VERSION, and set commits retained to 10 (this config is supposed to work only for LATEST_COMMITS policy). after 15 commits, we will consider only the last 10 commits to do clean up, what incase some file group never got updated from C5 to C15. So, those file groups should also be considered right when we are looking to schedule cleaning based on FILE_VERSIONS. Open to jam more on this and find a good enhancement. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
