[
https://issues.apache.org/jira/browse/FLINK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17322989#comment-17322989
]
Flink Jira Bot commented on FLINK-18578:
----------------------------------------
This issue is assigned but has not received an update in 7 days so it has been
labeled "stale-assigned". If you are still working on the issue, please give an
update and remove the label. If you are no longer working on the issue, please
unassign so someone else may work on it. In 7 days the issue will be
automatically unassigned.
> Add rejecting checkpoint logic in source
> ----------------------------------------
>
> Key: FLINK-18578
> URL: https://issues.apache.org/jira/browse/FLINK-18578
> Project: Flink
> Issue Type: New Feature
> Components: Connectors / Common, Runtime / Checkpointing
> Reporter: Qingsheng Ren
> Assignee: Qingsheng Ren
> Priority: Major
> Labels: stale-assigned
>
> Under some database's change data capture (CDC) case, the process is usually
> divided into two phases: snapshotting phase (lock captured tables and scan
> all records in them) and log streaming phase (read all changes starting from
> the moment of locking tables) in order to build a complete view of captured
> tables. The first snapshotting phase should be atomic so we have to give up
> all records created in snapshotting phase if any failure happen, because
> contents in captured tables might have changed during recovery. And
> checkpointing within snapshotting phase is meaningless too.
> As a result, we need to add a new feature in the source to reject checkpoint
> if the source is currently within an atomic operation or some other processes
> that cannot do a checkpoint currently. This rejection should not be treated
> as a failure that could lead to failure of the entire job.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
