[
https://issues.apache.org/jira/browse/FLINK-34766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828693#comment-17828693
]
Flink CDC Issue Import commented on FLINK-34766:
------------------------------------------------
Date: Mon Feb 05 19:22:16 CST 2024, Author:
[loserwang1024|https://github.com/loserwang1024]
hi, @gunnarmorling, in JdbcIncrementalSource connector, only when checkpoint
is enabled, the enumerator will assign stream split.
```java
@Override
public void notifyCheckpointComplete(long checkpointId) {
// we have waited for at-least one complete checkpoint after all
snapshot-splits are
// finished, then we can mark snapshot assigner as finished.
if (checkpointIdToFinish != null && !assignerFinished &&
allSplitsFinished()) {
assignerFinished = checkpointId >= checkpointIdToFinish;
LOG.info("Snapshot split assigner is turn into finished status.");
}
}
```
The PG CDC connector no longer recommends the non-incremental version of CDC;
therefore, I believe this issue has been resolved.
> Ensure checkpointing is enabled for Postgres connector
> ------------------------------------------------------
>
> Key: FLINK-34766
> URL: https://issues.apache.org/jira/browse/FLINK-34766
> Project: Flink
> Issue Type: Improvement
> Components: Flink CDC
> Reporter: Flink CDC Issue Import
> Priority: Major
> Labels: github-import
>
> **Is your feature request related to a problem? Please describe.**
> Yes, it is: when not enabling checkpointing with the Debezium-based Postgres
> connector, then the replication slot in the database will never be advanced
> (as this is triggered by committing offsets in Debezium, which in turn is
> triggered by checkpointing in Flink CDC), causing WAL to be retained
> indefinitely.
> **Describe the solution you'd like**
> Raise a warning or even an exception when using this connector without
> checkpointing.
> **Describe alternatives you've considered**
> n/a
> ---------------- Imported from GitHub ----------------
> Url: https://github.com/apache/flink-cdc/issues/1866
> Created by: [gunnarmorling|https://github.com/gunnarmorling]
> Labels: enhancement,
> Assignee: [gunnarmorling|https://github.com/gunnarmorling]
> Created at: Tue Jan 10 20:43:21 CST 2023
> State: open
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
