[
https://issues.apache.org/jira/browse/FLINK-35938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Leonard Xu reassigned FLINK-35938:
----------------------------------
Assignee: LvYanquan
> Avoid commit the same datafile again in Paimon Sink.
> ----------------------------------------------------
>
> Key: FLINK-35938
> URL: https://issues.apache.org/jira/browse/FLINK-35938
> Project: Flink
> Issue Type: Technical Debt
> Components: Flink CDC
> Affects Versions: cdc-3.1.0
> Reporter: LvYanquan
> Assignee: LvYanquan
> Priority: Critical
> Fix For: cdc-3.2.0
>
> Attachments: image-2024-07-31-19-45-14-153.png
>
>
> [Flink will re-commit
> committables|https://github.com/apache/flink/blob/82b628d4730eef32b2f7a022e3b73cb18f950e6e/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/connector/sink2/GlobalCommitterOperator.java#L148]
> when job restart from failure. This may cause the same datafile were added
> twice in current PaimonCommitter.
> !image-2024-07-31-19-45-14-153.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
