[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795645#comment-17795645
]
Bo Cui edited comment on HUDI-7132 at 12/12/23 8:50 AM:
--------------------------------------------------------
>From the code, this pr ([https://github.com/apache/hudi/pull/9867/files])
>fixes the logic during initialization,
but it doesn't fix the logic when a subtask fails, Like this logic, is my
understanding correct?
!screenshot-1.png|width=750,height=379!
was (Author: bo cui):
>From the code, this pr (https://github.com/apache/hudi/pull/9867/files) fixes
>the logic during initialization,
but it doesn't fix the logic when a subtask fails, Like this logic, is my
understanding correct?
!screenshot-1.png!
> Data may be lost in Flink checkpoint
> ------------------------------------
>
> Key: HUDI-7132
> URL: https://issues.apache.org/jira/browse/HUDI-7132
> Project: Apache Hudi
> Issue Type: Bug
> Components: flink
> Affects Versions: 0.13.1, 0.14.0
> Reporter: Bo Cui
> Priority: Major
> Labels: pull-request-available
> Attachments: screenshot-1.png
>
>
> https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L524C23-L524C35
> before the line code, eventBuffer may be updated by `subtaskFailed`, and some
> elements of eventBuffer is null
> https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L305C10-L305C21
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
