voonhous commented on PR #7669: URL: https://github.com/apache/hudi/pull/7669#issuecomment-1409656592
For the concerns raised in: https://github.com/apache/hudi/pull/7669#issuecomment-1408352092 The files that have been removed in the `CLEAN-0` operation will not be listed again in `CLEAN-1`. So, there will not be any `FileNotFoundException` exceptions to be caught. i.e. No log warnings lines that may raise unnecessary "alarms". This is so as: 1. Clean will always ensure that every FileGroup will have at least 1 FileSlice left after cleaning. So, if there is only 1 FileSlice in the FileGroup, it will not be a candidate for cleaning 2. `DROP-PARTITION` will flags FileGroups to be removed. Hence, it is still up to the cleaner to identify the remaining files that need to be removed. i.e. FileSlices that have not been removed yet/FileSlices that are not candidates for removal by previous clean operations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
