danny0405 commented on issue #11090: URL: https://github.com/apache/hudi/issues/11090#issuecomment-2097357620
> clean.retain_commits was 1 That means each time a new version of file generated, the old one would be deleted, for "COW" table, there is very high possibility you would encouter file missing exception because files are being deleted for every new commits. Can you just keep the `clean.retain_commits` as default to give the streaming reader some buffer time to read the new files. > By the way,how to configue the clean.async.enabled Should be true if you do not want redundant legacy files on the filesystem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
