danny0405 commented on issue #5395: URL: https://github.com/apache/hudi/issues/5395#issuecomment-1111652198
> deleteAnyLeftOverMarkers I'm not quite sure, we actually clean the MARKER folder each time we commit an instant, and here we do it again when the instant was archived? (curious about the background here ?), and like what @codope saied, the call in [#L682-L684](https://github.com/apache/hudi/blob/762623a15cfeba6f3fe936c238d660685ae62b50/hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java#L682-L684) already delete recursively first. The instant commit and archiving both happens in JobManager in single thread, so there should not be parallelism problem. @todd5167 Did you write to the same table from two separate Flink jobs ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
