jaedongjuly opened a new issue, #8977: URL: https://github.com/apache/seatunnel/issues/8977
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened 任务一共同步 2张表 一个 build 和一个city表 build 表更新频繁。city更新不频繁 任务启动后 build 和city表同步数据正常 且 cdc 同步正常 mysql binlog 过期时间 7天； city表依旧会获取最初的binlog 文件和偏移量。导致binlog 过期，任务失败 ### SeaTunnel Version 2.3.7 ### SeaTunnel Config ```conf 第一个 任务 配置 env { # you can set SeaTunnel environment configuration here parallelism = 8 job.mode = "STREAMING" checkpoint.interval = 20000 } source { MySQL-CDC { base-url = "jdbc:mysql://ip:port/db1?rewriteBatchedStatements=true&useUnicode=true&characterEncoding=UTF8&serverTimezone=Asia/Shanghai&useSSL=false&verifyServerCertificate=false&autoReconnect=true&failOverReadOnly=false" username = "xxx" password = "xxx" table-names = ["db1.build"] result_table_name = "build" startup.mode = "initial" } transform { Sql { source_table_name = "build" result_table_name = "build1" query = "select * from build" } } sink { Jdbc { source_table_name = "build1" url = "jdbc:mysql://xxxx/db2?rewriteBatchedStatements=true&useUnicode=true&characterEncoding=UTF8&serverTimezone=Asia/Shanghai&useSSL=false&verifyServerCertificate=false&autoReconnect=true&failOverReadOnly=false" driver = "com.mysql.cj.jdbc.Driver" connection_check_timeout_sec = 100 user = "xxx" password = "xxxx" primary_keys = ["id"] generate_sink_sql = true database = db2 table = build } } 第二个 配置 env { # you can set SeaTunnel environment configuration here parallelism = 8 job.mode = "STREAMING" checkpoint.interval = 20000 } source { MySQL-CDC { base-url = "jdbc:mysql://ip:port/db1?rewriteBatchedStatements=true&useUnicode=true&characterEncoding=UTF8&serverTimezone=Asia/Shanghai&useSSL=false&verifyServerCertificate=false&autoReconnect=true&failOverReadOnly=false" username = "xxx" password = "xxx" table-names = ["db1.city"] result_table_name = "city" startup.mode = "initial" } transform { Sql { source_table_name = "city" result_table_name = "city1" query = "select * from city" } } sink { Jdbc { source_table_name = "city1" url = "jdbc:mysql://xxxx/db2?rewriteBatchedStatements=true&useUnicode=true&characterEncoding=UTF8&serverTimezone=Asia/Shanghai&useSSL=false&verifyServerCertificate=false&autoReconnect=true&failOverReadOnly=false" driver = "com.mysql.cj.jdbc.Driver" connection_check_timeout_sec = 100 user = "xxx" password = "xxxx" primary_keys = ["id"] generate_sink_sql = true database = db2 table = city } } ``` ### Running Command ```shell seatunnel.sh ``` ### Error Exception ```log Caused by: java.lang.IllegalStateException: The connector is trying to read binlog starting at Struct{version=1.9.8.Final,connector=mysql,name=mysql_binlog_source,ts_ms=1741153886563,db=,server_id=0,file=mysql-bin.000819,pos=68977018,row=0}, but this is no longer available on the server. Reconfigure the connector to use a snapshot when needed. at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.reader.fetch.MySqlSourceFetchTaskContext.loadStartingOffsetState(MySqlSourceFetchTaskContext.java:281) at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.reader.fetch.MySqlSourceFetchTaskContext.configure(MySqlSourceFetchTaskContext.java:127) at org.apache.seatunnel.connectors.cdc.base.source.reader.external.IncrementalSourceStreamFetcher.submitTask(IncrementalSourceStreamFetcher.java:97) at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceSplitReader.checkSplitOrStartNext(IncrementalSourceSplitReader.java:147) at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceSplitReader.fetch(IncrementalSourceSplitReader.java:71) at org.apache.seatunnel.connectors.seatunnel.common.source.reader.fetcher.FetchTask.run(FetchTask.java:54) at org.apache.seatunnel.connectors.seatunnel.common.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:162) ``` ### Zeta or Flink or Spark Version _No response_ ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
