[
https://issues.apache.org/jira/browse/HUDI-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ethan Guo updated HUDI-5817:
----------------------------
Description: Even though the async indexer metadata writer is configured to
use LAZY failed write cleaning policy, there is other logic that can
potentially roll back the delta commits from regular metadata writer, e.g.,
since heartbeats are disabled for regular MDT writes, failed write cleaning is
going to rollback commits regardless. We need to fix this so that the async
indexer metadata writer does not touch other delta commits in the MDT. (was:
Even though the async indexer metadata writer )
> Fix async indexer metadata writer to avoid eager rollback / cleaning
> --------------------------------------------------------------------
>
> Key: HUDI-5817
> URL: https://issues.apache.org/jira/browse/HUDI-5817
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: Ethan Guo
> Priority: Major
>
> Even though the async indexer metadata writer is configured to use LAZY
> failed write cleaning policy, there is other logic that can potentially roll
> back the delta commits from regular metadata writer, e.g., since heartbeats
> are disabled for regular MDT writes, failed write cleaning is going to
> rollback commits regardless. We need to fix this so that the async indexer
> metadata writer does not touch other delta commits in the MDT.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
