sivabalan narayanan created HUDI-2436:
-----------------------------------------
Summary: rollback in cloud stores w/o append, wrt collecting log
files to be deleted/logged
Key: HUDI-2436
URL: https://issues.apache.org/jira/browse/HUDI-2436
Project: Apache Hudi
Issue Type: Improvement
Components: Writer Core
Reporter: sivabalan narayanan
Fix For: 0.10.0
In cloud stores that does not support append, if there was a crash during
writing to a log file. and later rollback was triggered for this failed commit,
this last log file may not be returned when listing all log files written for
this commit of interest. but is there a chance that log files that the rollback
is committed/logged, uses the same log file name as the one that got failed?
- with hdfs type of cloud stores, where appends are allowed, we just create new
log blocks. and hence should not be an issue.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
