[
https://issues.apache.org/jira/browse/HUDI-7132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Cui updated HUDI-7132:
-------------------------
Description:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L524C23-L524C35
before the line code, eventBuffer may be updated by `subtaskFailed`, and some
elements of eventBuffer is null
we can add a lock to the 2 line to solve the problem.
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L305C10-L305C21
was:
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L524C23-L524C35
before the line code, eventBuffer may be updated by `subtaskFailed`, and some
elements of eventBuffer is null
https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L305C10-L305C21
> Data may be lost in flink#chk
> -----------------------------
>
> Key: HUDI-7132
> URL: https://issues.apache.org/jira/browse/HUDI-7132
> Project: Apache Hudi
> Issue Type: Bug
> Components: flink
> Affects Versions: 1.1.0
> Reporter: Bo Cui
> Priority: Major
>
> https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L524C23-L524C35
> before the line code, eventBuffer may be updated by `subtaskFailed`, and some
> elements of eventBuffer is null
> we can add a lock to the 2 line to solve the problem.
> https://github.com/apache/hudi/blob/a1afcdd989ce2d634290d1bd9e099a17057e6b4d/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java#L305C10-L305C21
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
