[
https://issues.apache.org/jira/browse/HUDI-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-2436:
--------------------------------------
Summary: rollback in cloud stores w/o append, wrt collecting failed log
files to be deleted/logged (was: rollback in cloud stores w/o append, wrt
collecting log files to be deleted/logged)
> rollback in cloud stores w/o append, wrt collecting failed log files to be
> deleted/logged
> -----------------------------------------------------------------------------------------
>
> Key: HUDI-2436
> URL: https://issues.apache.org/jira/browse/HUDI-2436
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Writer Core
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Fix For: 0.10.0
>
>
> In cloud stores that does not support append, if there was a crash during
> writing to a log file. and later rollback was triggered for this failed
> commit, this last log file may not be returned when listing all log files
> written for this commit of interest. but is there a chance that log files
> that the rollback is committed/logged, uses the same log file name as the one
> that got failed?
>
> - with hdfs type of cloud stores, where appends are allowed, we just create
> new log blocks. and hence should not be an issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
