Flink CDC Issue Import created FLINK-34776:
----------------------------------------------
Summary: mysql cdc restart from checkpoint failed when some binlog
file has been purged
Key: FLINK-34776
URL: https://issues.apache.org/jira/browse/FLINK-34776
Project: Flink
Issue Type: Bug
Components: Flink CDC
Reporter: Flink CDC Issue Import
### Search before asking
- [X] I searched in the
[issues|https://github.com/ververica/flink-cdc-connectors/issues] and found
nothing similar.
### Flink version
1.14.6
### Flink CDC version
2.3.X
### Database and its version
aws rds
### Minimal reproduce step
1.start flink cdc connector job
2.clean some binlog file
3.restart from checkpoint
### What did you expect to see?
restart normally
### What did you see instead?
restart failed
io.debezium.DebeziumException: The connector is trying to read binlog starting
at SourceInfo [currentGtid=null, currentBinlogFilename=mysql-bin.xxx,
currentBinlogPosition=xxx, currentRowNumber=0, serverId=0, sourceTime=null,
threadId=-1, currentQuery=null, tableIds=[], databaseName=null], but this is no
longer available on the server. Reconfigure the connector to use a snapshot
when needed. at
io.debezium.connector.mysql.MySqlConnectorTask.validateSnapshotFeasibility(MySqlConnectorTask.java:329)
at
io.debezium.connector.mysql.MySqlConnectorTask.start(MySqlConnectorTask.java:98)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:130)
at io.debezium.embedded.EmbeddedEngine.run(EmbeddedEngine.java:759) at
io.debezium.embedded.ConvertingEngineBuilder$2.run(ConvertingEngineBuilder.java:188)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
### Anything else?
_No response_
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
---------------- Imported from GitHub ----------------
Url: https://github.com/apache/flink-cdc/issues/1947
Created by: [dylenWu|https://github.com/dylenWu]
Labels: bug,
Created at: Mon Feb 27 15:24:18 CST 2023
State: open
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
