[jira] [Created] (FLINK-35938) Avoid commit the same datafile again in Paimon Sink.

[LvYanquan (Jira)]

LvYanquan created FLINK-35938:
---------------------------------

             Summary: Avoid commit the same datafile again in Paimon Sink.
                 Key: FLINK-35938
                 URL: https://issues.apache.org/jira/browse/FLINK-35938
             Project: Flink
          Issue Type: Technical Debt
          Components: Flink CDC
    Affects Versions: cdc-3.1.0
            Reporter: LvYanquan
             Fix For: cdc-3.2.0
         Attachments: image-2024-07-31-19-45-14-153.png

[Flink will re-commit 
committables|https://github.com/apache/flink/blob/82b628d4730eef32b2f7a022e3b73cb18f950e6e/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/connector/sink2/GlobalCommitterOperator.java#L148]
 when job restart from failure. This may cause the same datafile were added 
twice in current PaimonCommitter.




!image-2024-07-31-19-45-14-153.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)