[
https://issues.apache.org/jira/browse/FLINK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongmin Qiao updated FLINK-36397:
----------------------------------
Attachment: picture1.png
Description: !picture1.png|width=550,height=348! Using the offset obtained
after a query transaction as a high watermark cannot ensure exactly-once
semantics because "show master status" and the query action are not in the same
transaction. There may be data inserted between the query action and the
retrieval of the high watermark. As a result, these data will be lost since we
only deliver data after the high watermark during the binlog phase. (was:
!image-2024-09-22-16-51-09-930.png|width=547,height=346!
Using the offset obtained after a query transaction as a high watermark cannot
ensure exactly-once semantics because "show master status" and the query action
are not in the same transaction. There may be data inserted between the query
action and the retrieval of the high watermark. As a result, these data will be
lost since we only deliver data after the high watermark during the binlog
phase.)
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics.
> -------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-36397
> URL: https://issues.apache.org/jira/browse/FLINK-36397
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Affects Versions: cdc-3.2.0
> Reporter: Zhongmin Qiao
> Priority: Major
> Fix For: cdc-3.2.1
>
> Attachments: picture1.png
>
>
> !picture1.png|width=550,height=348! Using the offset obtained after a query
> transaction as a high watermark cannot ensure exactly-once semantics because
> "show master status" and the query action are not in the same transaction.
> There may be data inserted between the query action and the retrieval of the
> high watermark. As a result, these data will be lost since we only deliver
> data after the high watermark during the binlog phase.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
