Prashant Wason created HUDI-6151:
------------------------------------
Summary: Rollback previously applied commits to MDT when
operations are retried.
Key: HUDI-6151
URL: https://issues.apache.org/jira/browse/HUDI-6151
Project: Apache Hudi
Issue Type: Bug
Reporter: Prashant Wason
Assignee: Prashant Wason
Operations like Clean, Compaction are retried after failures with the same
instant time. If the previous run of the operation successfully committed to
the MDT but failed to commit to the dataset, then the operation will be retried
later with the same instantTime causing duplicate updates applied to MDT.
Currently, we simply delete the completed deltacommit without rolling back the
deltacommit.
To handle this, we detect a replay of operation and rollback any changes from
that operation in MDT.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
