[
https://issues.apache.org/jira/browse/HUDI-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17440529#comment-17440529
]
Vinoth Chandar commented on HUDI-2478:
--------------------------------------
the main complexity here is actually during the rollback. i.e we first try
bootstrapping at commit time t1 and we fail midway. Then we re-attempt at
commit time t2, then first we will do eager cleanup of the t1.inflight, by
logging rollback blocks which will re-create the file group buckets again.
Better approach is to do a `delete_partition` operation and avoid messing with
the files directly. Thinking more.
> Handle failure mid-way during init buckets
> ------------------------------------------
>
> Key: HUDI-2478
> URL: https://issues.apache.org/jira/browse/HUDI-2478
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: sivabalan narayanan
> Assignee: Vinoth Chandar
> Priority: Blocker
> Fix For: 0.10.0
>
>
> If process crashes mid-way while instantiating buckets, if tried again, it
> should work seamlessly.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
