[jira] [Created] (FLINK-36347) Using the offset obtained after a query transaction as a high watermark cannot ensure exactly-once semantics.

[Zhongmin Qiao (Jira)]

Zhongmin Qiao created FLINK-36347:
-------------------------------------

             Summary: Using the offset obtained after a query transaction as a 
high watermark cannot ensure exactly-once semantics.
                 Key: FLINK-36347
                 URL: https://issues.apache.org/jira/browse/FLINK-36347
             Project: Flink
          Issue Type: Bug
          Components: Flink CDC
    Affects Versions: cdc-3.2.0
            Reporter: Zhongmin Qiao
             Fix For: cdc-3.2.1
         Attachments: image-2024-09-22-16-51-09-930.png

!image-2024-09-22-16-51-09-930.png!

Using the offset obtained after a query transaction as a high watermark cannot 
ensure exactly-once semantics because "show master status" and the query action 
are not in the same transaction. There may be data inserted between the query 
action and the retrieval of the high watermark. As a result, these data will be 
lost since we only deliver data after the high watermark during the binlog 
phase.

 

 

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)