xxubai opened a new issue, #3608: URL: https://github.com/apache/amoro/issues/3608
### Search before asking - [x] I have searched in the [issues](https://github.com/apache/amoro/issues?q=is%3Aissue) and found no similar issues. ### What would you like to be improved? Currently, when cleaning up snapshots, if the service crashes or restarts, the ongoing physical file deletion process will be interrupted and cannot resume. These service restarts are often caused by OOM issues, which may be related to an excessive number of file paths to delete (e.g., millions of expired historical files). ### How should we improve? To address this issue, I propose the following suggestions: 1. Persist the state of expired snapshots so that the file deletion process can resume after a service restart. 2. Avoid expiring a large number of historical files all at once by performing the cleanup in batches. ### Are you willing to submit PR? - [x] Yes I am willing to submit a PR! ### Subtasks _No response_ ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
