hudi-bot opened a new issue, #15422: URL: https://github.com/apache/hudi/issues/15422
rollbackInflightLogCompaction(inflightInstant, s -> Option.empty()); *Comments* shouldn't we pass getPendingRollbackInstantFunc in the 2nd argument. the reason why we introduced the pending rollback is below. Lets say c5 commit partially failed. when we are looking to start a new commit, say C7, we deduct that c5 has failed and we trigger a rollback named RB_5. But lets say the process crashed mid-way for RB_5. Next time we restart the pipeline for say C8. again we deduct that c5 is partially failed and we want to rollback. but we don't want to create RB_9 for this,but re-use RB_5 again and get it to completion. So, rollbackPendingCompaction or rollbackPendingClustering should always try to re-use rollback instants if any. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-4829 - Type: Bug - Epic: https://issues.apache.org/jira/browse/HUDI-3580 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
