nsivabalan edited a comment on pull request #4078: URL: https://github.com/apache/hudi/pull/4078#issuecomment-1003733631
Thanks to the detailed code flow diagram. Very useful. I have one question on the flow. When a job failed during cleaning up of small archive files: 1. We deserialize the plan and get all candidates. 2. If not all candidates exists, it means that stage 4 succeeded and stage 5 failed. 3. Delete all left over small archive files. 4. Go on to "Select merge candidates" : This refers to a new batch of merging right? From the diagram its not very apparent whether we are retrying the same batch or going ahead w/ a new batch. Can you confirm my understanding here please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
