[
https://issues.apache.org/jira/browse/FLINK-36397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongmin Qiao updated FLINK-36397:
----------------------------------
Description: !picture1.png|width=564,height=357! Using the offset obtained
after a query transaction as a high watermark cannot ensure exactly-once
semantics because "show master status" and the query action are not in the same
transaction. There may be data inserted between the query action and the
retrieval of the high watermark. As a result, these data will be lost since we
only deliver data after the high watermark during the binlog phase. (was:
!picture1.png|width=550,height=348! Using the offset obtained after a query
transaction as a high watermark cannot ensure exactly-once semantics because
"show master status" and the query action are not in the same transaction.
There may be data inserted between the query action and the retrieval of the
high watermark. As a result, these data will be lost since we only deliver data
after the high watermark during the binlog phase.)
> Using the offset obtained after a query transaction as a high watermark
> cannot ensure exactly-once semantics.
> -------------------------------------------------------------------------------------------------------------
>
> Key: FLINK-36397
> URL: https://issues.apache.org/jira/browse/FLINK-36397
> Project: Flink
> Issue Type: Bug
> Components: Flink CDC
> Affects Versions: cdc-3.2.0
> Reporter: Zhongmin Qiao
> Priority: Major
> Fix For: cdc-3.2.1
>
> Attachments: picture1.png
>
>
> !picture1.png|width=564,height=357! Using the offset obtained after a query
> transaction as a high watermark cannot ensure exactly-once semantics because
> "show master status" and the query action are not in the same transaction.
> There may be data inserted between the query action and the retrieval of the
> high watermark. As a result, these data will be lost since we only deliver
> data after the high watermark during the binlog phase.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
