hudi-bot opened a new issue, #15973: URL: https://github.com/apache/hudi/issues/15973
We have hours based policy/configs for cleaning, but archival only has num_commits based configs. So, as of now, user/dev has to ensure they both align well together. We should derive archival configs automatically from cleaner configs. for eg, if cleaner configs is 48 hours, we can add 10% more for archival min commits and 20% for max commits. So, archival window can be 53 hours -> 58 hours. we can expose configs for these percentage if need be. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-6252 - Type: Improvement -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
