[
https://issues.apache.org/jira/browse/FLINK-36347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongmin Qiao updated FLINK-36347:
----------------------------------
Description:
!image-2024-09-22-16-51-09-930.png|width=891,height=564!
Using the offset obtained after a query transaction as a high watermark cannot
ensure exactly-once semantics because "show master status" and the query action
are not in the same transaction. There may be data inserted between the query
action and the retrieval of the high watermark. As a result, these data will be
lost since we only deliver data after the high watermark during the binlog
phase.
was:
!image-2024-09-22-16-51-09-930.png!
Using the offset obtained after a query transaction as a high watermark cannot
ensure exactly-once semantics because "show master status" and the query action
are not in the same transaction. There may be data inserted between the query
action and the retrieval of the high watermark. As a result, these data will be
lost since we only deliver data after the high watermark during the binlog
phase.
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics.
> -------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-36347
> URL: https://issues.apache.org/jira/browse/FLINK-36347
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Affects Versions: cdc-3.2.0
> Reporter: Zhongmin Qiao
> Priority: Major
> Fix For: cdc-3.2.1
>
> Attachments: image-2024-09-22-16-51-09-930.png
>
>
> !image-2024-09-22-16-51-09-930.png|width=891,height=564!
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics because "show master status" and the
> query action are not in the same transaction. There may be data inserted
> between the query action and the retrieval of the high watermark. As a
> result, these data will be lost since we only deliver data after the high
> watermark during the binlog phase.
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
