sivabalan narayanan created HUDI-6736:
-----------------------------------------
Summary: Change the order of rollback transitioning to complete
and actual commit timeline files deletion
Key: HUDI-6736
URL: https://issues.apache.org/jira/browse/HUDI-6736
Project: Apache Hudi
Issue Type: Bug
Components: writer-core
Reporter: sivabalan narayanan
After [https://github.com/apache/hudi/pull/8849/], the order of rollback
transitioning to completion and actual commit timeline files (the commit that
is getting rolled back) is changed.
we first transition the rollback to completion, and then delete the commit
files. But if there is a crash inbetween these two steps, next time, the commit
of interest could be deduced as pending and another rollback could get
triggered. So, we want to change the ordering.
We have made a fix towards this end already. so that, a rollback can go ahead
and complete itself even if the commit timeline files are missing. This refers
to the scenario, where in, we change the order and then a crash happens just
b/w these two steps.
Ref: [https://github.com/apache/hudi/pull/5148]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
