nsivabalan commented on issue #5020: URL: https://github.com/apache/hudi/issues/5020#issuecomment-1125164707
yes, thats expected right. User has configured cleaner policy as KEEP_LATEST_COMMITS. and so hudi honors that. but if your use-case is such that, not every ingest will update every file group, may be you can try KEEP_LATEST_FILE_VERSIONS. That way we can be sure that hudi will always retain 5 file slices for every file group (if configured to be 5). Do you think that would work ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
