[
https://issues.apache.org/jira/browse/HUDI-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889488#comment-17889488
]
Y Ethan Guo edited comment on HUDI-8282 at 10/15/24 7:45 AM:
-------------------------------------------------------------
This means that the metadata writer does not write markers for log files for
file group initialization. The latter one in BaseRollbackHelper needs to be
revisited too. We assume that there is no rollback blocks added by the log
files but the logic still adds rollback log block.
was (Author: JIRAUSER280684):
This means that the metadata writer does not write markers for log files. The
latter one in BaseRollbackHelper needs to be revisited too. We assume that
there is no rollback blocks added by the log files but the logic still adds
rollback log block.
> Create per log file marker for 1.x
> -----------------------------------
>
> Key: HUDI-8282
> URL: https://issues.apache.org/jira/browse/HUDI-8282
> Project: Apache Hudi
> Issue Type: Improvement
> Components: writer-core
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Blocker
> Fix For: 1.0.0
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> This ticket is meant for 1.x. We added per log file marker which was added to
> 0.x branch https://issues.apache.org/jira/browse/HUDI-1517
>
> Commit of interest:
> [https://github.com/apache/hudi/commit/c2c7e0538f8cf3031781ebdd776d1c03bfec3bb3]
>
>
> We might need to add a similar support to 1.x, hence the tracking ticket.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
