KnightChess commented on issue #9101: URL: https://github.com/apache/hudi/issues/9101#issuecomment-1617563560
@danny0405 yes, it will recompute again, there will be multiple commit instances in a offline task cycle like daily cycle, in this day, there should be one commit instance in theory, but has two commit instance. > Did you have some clue why the job fails when cleaning? first cycle: we meet #7837, so it should be rollback in next batch etl (we open `occ`), second cycle: After instance commit, it will rollback failed instance if open occ, and there is something bug in our Rss(Remote shuffle service), so rollback will failed, and the job failed and spark will retry again, in this daily cycle will recompute again and create new commit instance based before instance which job is failed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
