cshuo commented on issue #19649: URL: https://github.com/apache/hudi/issues/19649#issuecomment-5323469331
Thks for reporting the issue, I think we need to fix this in two places: 1. In `LSMTimeline#getManifestFilePathFilter()` and `getManifestVersion()`, only files matching `^manifest_\\d+$` should be treated as valid manifests. Temporary files like `manifest_114.<uuid>` should simply be ignored. 2. In `HoodieStorage#createImmutableFileInPath()`, the temporary file should only be renamed after both write and close succeed. If write, close, or rename fails, we should try to clean it up without hiding the original exception. For now, the leftover `manifest_114.<uuid>` can be deleted directly, as long as no timeline archival is running. That should unblock the job, but the code changes are still needed to prevent it from happening again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
