[
https://issues.apache.org/jira/browse/FLINK-36347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongmin Qiao updated FLINK-36347:
----------------------------------
External issue URL: https://github.com/apache/flink-cdc/pull/3616
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics.
> -------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-36347
> URL: https://issues.apache.org/jira/browse/FLINK-36347
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Affects Versions: cdc-3.2.0
> Reporter: Zhongmin Qiao
> Priority: Major
> Fix For: cdc-3.2.1
>
> Attachments: image-2024-09-22-16-51-09-930.png
>
>
> !image-2024-09-22-16-51-09-930.png|width=891,height=564!
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics because "show master status" and the
> query action are not in the same transaction. There may be data inserted
> between the query action and the retrieval of the high watermark. As a
> result, these data will be lost since we only deliver data after the high
> watermark during the binlog phase.
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
