silent-night-no-trace opened a new issue, #9901: URL: https://github.com/apache/seatunnel/issues/9901
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened Unable to synchronize mysql-cdc data. Seatunnel task execution completes the snapshot part and then stops quickly. But the task list is still running. 1023880025205637138 ods_user_cdc555 RUNNING 2025-09-26 16:53:43.771 ### SeaTunnel Version 2.3.11 ### SeaTunnel Config ```conf env { # 环境配置 parallelism = 2 # 增加并行度以提高吞吐量 job.mode = "STREAMING" # 使用流式处理模式进行实时同步 checkpoint.interval = 10000 # 检查点间隔，单位毫秒 # 限流配置 - 避免对源数据库造成过大压力 read_limit.bytes_per_second = 10000000 # 每秒读取字节数限制，约10MB/s read_limit.rows_per_second = 1000 # 每秒读取行数限制 # 本地检查点配置 execution.checkpoint.data-uri = "file:///opt/seatunnel/checkpoints" execution.checkpoint.max-concurrent = 1 # 最大并发检查点数 # 性能优化参数 execution.buffer-timeout = 5000 # 缓冲超时时间(毫秒) execution.jvm-options = "-Xms4g -Xmx8g -XX:+UseG1GC -XX:MaxGCPauseMillis=100" } source { MySQL-CDC { # 基本连接配置 server-id = 5652-5662 # MySQL复制客户端的唯一ID范围 base-url = "jdbc:mysql://xxxxx:3306/sp?useUnicode=true&characterEncoding=UTF-8&connectionTimezone=Asia/Shanghai&useSSL=false&rewriteBatchedStatements=true&useServerPrepStmts=true&cachePrepStmts=true" username = "root" password = "a+xxxx" table-names = ["sp.us_channel_user"] # 要同步的表 # CDC 特有配置 schema-changes.enabled = true # 启用架构变更捕获 connection-time-zone = "Asia/Shanghai" # 服务器时区 stop.never = true # 性能优化配置 snapshot.mode = "initial" # 初始快照模式 snapshot.fetch.size = 10000 # 快照获取大小 chunk.size.rows = 8096 # 分块大小，用于并行快照 connection.pool.size = 10 # 连接池大小 # 高级配置 include.schema.changes = true # 包含架构变更事件 stop.mode = "never" scan.startup.mode = "initial" # 启动模式：initial(全量+增量) #scan.incremental.snapshot.chunk.size = 8096 # 增量快照分块大小 debezium.min.row.count.to.stream.results = 1000 # 流式结果的最小行数 # 容错配置 connect.timeout = 30000 # 连接超时时间(毫秒) connect.max-retries = 3 # 最大重试次数 # 输出表名 result_table_name = "mysql_user_cdc_source" } } # 可选的转换逻辑，如果需要对数据进行处理 transform { Sql { source_table_name = "mysql_user_cdc_source" result_table_name = "kafka_sink_data" # 根据需要转换字段，这里添加了一个分区字段k1 query = """ SELECT 'SP' AS 'application_code', channel_id AS 'channel_code', id AS 'user_id', phone AS 'mobile', real_name AS 'name', account, created_time AS 'register_time' FROM mysql_user_cdc_source """ } } sink { kafka { topic = "user_topic" bootstrap.servers = "192.168.109.211:9092,192.168.109.212:9092,192.168.109.213:9092" format = json kafka.request.timeout.ms = 60000 kafka.config = { acks = "all" request.timeout.ms = 60000 buffer.memory = 33554432 key.serializer = "org.apache.kafka.common.serialization.StringSerializer" value.serializer = "org.apache.kafka.common.serialization.StringSerializer" } } } ``` ### Running Command ```shell bin/seatunnel.sh --config config/ods_user_cdc.conf -m cluster -n ods_user_cdc555 --async ``` ### Error Exception ```log [1023880025205637138] 2025-09-26 16:54:12,698 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:7' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:12,861 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:7', total duration '00:00:00.163' [1023880025205637138] 2025-09-26 16:54:12,869 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429501480, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420997, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772874468517187585], splitEnd=[1772877639754944513], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:16,768 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:7] [1023880025205637138] 2025-09-26 16:54:20,768 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:7] [1023880025205637138] 2025-09-26 16:54:20,774 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-26] - subtask 0 add splits: sp.us_channel_user:9 [1023880025205637138] 2025-09-26 16:54:20,788 INFO [e.IncrementalSourceScanFetcher] [debezium-snapshot-reader-0] - Start snapshot read task for snapshot split: SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772878755041349633], splitEnd=[1772883539110629378], lowWatermark=null, highWatermark=null) exactly-once: false [1023880025205637138] 2025-09-26 16:54:20,792 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=mysql-maindb.001652, pos=429535620, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421055, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772878755041349633], splitEnd=[1772883539110629378], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:20,792 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 2 - Snapshotting data [1023880025205637138] 2025-09-26 16:54:20,792 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Exporting data from split 'sp.us_channel_user:9' of table sp.us_channel_user [1023880025205637138] 2025-09-26 16:54:20,792 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:9' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:20,981 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:9', total duration '00:00:00.189' [1023880025205637138] 2025-09-26 16:54:20,983 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429536835, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421058, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772878755041349633], splitEnd=[1772883539110629378], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:24,863 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:9] [1023880025205637138] 2025-09-26 16:54:28,863 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:9] [1023880025205637138] 2025-09-26 16:54:28,868 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-47] - subtask 0 add splits: sp.us_channel_user:11 [1023880025205637138] 2025-09-26 16:54:28,881 INFO [e.IncrementalSourceScanFetcher] [debezium-snapshot-reader-0] - Start snapshot read task for snapshot split: SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772885910691745793], splitEnd=[1772887175328927745], lowWatermark=null, highWatermark=null) exactly-once: false [1023880025205637138] 2025-09-26 16:54:28,882 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=mysql-maindb.001652, pos=429684440, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421273, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772885910691745793], splitEnd=[1772887175328927745], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:28,882 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 2 - Snapshotting data [1023880025205637138] 2025-09-26 16:54:28,882 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Exporting data from split 'sp.us_channel_user:11' of table sp.us_channel_user [1023880025205637138] 2025-09-26 16:54:28,883 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:11' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:29,092 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:11', total duration '00:00:00.209' [1023880025205637138] 2025-09-26 16:54:29,093 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429684440, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421273, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772885910691745793], splitEnd=[1772887175328927745], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:32,958 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:11] [1023880025205637138] 2025-09-26 16:54:36,958 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:11] [1023880025205637138] 2025-09-26 16:54:36,963 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-16] - subtask 0 add splits: sp.us_channel_user:13 [1023880025205637138] 2025-09-26 16:54:36,976 INFO [e.IncrementalSourceScanFetcher] [debezium-snapshot-reader-0] - Start snapshot read task for snapshot split: SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772892421128163330], splitEnd=[1772894278324031490], lowWatermark=null, highWatermark=null) exactly-once: false [1023880025205637138] 2025-09-26 16:54:36,977 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=mysql-maindb.001652, pos=429730692, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421322, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772892421128163330], splitEnd=[1772894278324031490], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:36,977 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 2 - Snapshotting data [1023880025205637138] 2025-09-26 16:54:36,977 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Exporting data from split 'sp.us_channel_user:13' of table sp.us_channel_user [1023880025205637138] 2025-09-26 16:54:36,977 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:13' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:37,150 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:13', total duration '00:00:00.173' [1023880025205637138] 2025-09-26 16:54:37,154 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429731915, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421325, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1772892421128163330], splitEnd=[1772894278324031490], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:41,054 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:13] [1023880025205637138] 2025-09-26 16:54:45,053 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:13] [1023880025205637138] 2025-09-26 16:54:45,058 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-40] - subtask 0 add splits: sp.us_channel_user:15 [1023880025205637138] 2025-09-26 16:54:45,071 INFO [e.IncrementalSourceScanFetcher] [debezium-snapshot-reader-0] - Start snapshot read task for snapshot split: SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1787731195030405121], splitEnd=[1905157195197612033], lowWatermark=null, highWatermark=null) exactly-once: false [1023880025205637138] 2025-09-26 16:54:45,073 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=mysql-maindb.001652, pos=429812070, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421455, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1787731195030405121], splitEnd=[1905157195197612033], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:45,073 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 2 - Snapshotting data [1023880025205637138] 2025-09-26 16:54:45,073 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Exporting data from split 'sp.us_channel_user:15' of table sp.us_channel_user [1023880025205637138] 2025-09-26 16:54:45,073 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:15' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:45,248 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:15', total duration '00:00:00.175' [1023880025205637138] 2025-09-26 16:54:45,250 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429812070, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421455, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1787731195030405121], splitEnd=[1905157195197612033], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:49,148 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:15] [1023880025205637138] 2025-09-26 16:54:53,149 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:15] [1023880025205637138] 2025-09-26 16:54:53,154 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-33] - subtask 0 add splits: sp.us_channel_user:17 [1023880025205637138] 2025-09-26 16:54:53,169 INFO [e.IncrementalSourceScanFetcher] [debezium-snapshot-reader-0] - Start snapshot read task for snapshot split: SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1909867905505214465], splitEnd=[1910579292367147009], lowWatermark=null, highWatermark=null) exactly-once: false [1023880025205637138] 2025-09-26 16:54:53,171 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 1 - Determining low watermark {ts_sec=0, file=mysql-maindb.001652, pos=429862616, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421517, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1909867905505214465], splitEnd=[1910579292367147009], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:53,171 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 2 - Snapshotting data [1023880025205637138] 2025-09-26 16:54:53,171 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Exporting data from split 'sp.us_channel_user:17' of table sp.us_channel_user [1023880025205637138] 2025-09-26 16:54:53,171 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - For split 'sp.us_channel_user:17' of table sp.us_channel_user using select statement: 'SELECT * FROM `sp`.`us_channel_user` WHERE `id` >= ? AND NOT (`id` = ?) AND `id` <= ?' [1023880025205637138] 2025-09-26 16:54:53,324 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Finished exporting 8095 records for split 'sp.us_channel_user:17', total duration '00:00:00.153' [1023880025205637138] 2025-09-26 16:54:53,326 INFO [f.s.MySqlSnapshotSplitReadTask] [debezium-snapshot-reader-0] - Snapshot step 3 - Determining high watermark {ts_sec=0, file=mysql-maindb.001652, pos=429864226, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421521, row=0, event=0} for split SnapshotSplit(tableId=sp.us_channel_user, splitKeyType=ROW<id BIGINT>, splitStart=[1909867905505214465], splitEnd=[1910579292367147009], lowWatermark=null, highWatermark=null) [1023880025205637138] 2025-09-26 16:54:57,243 INFO [o.a.s.c.s.c.s.r.f.SplitFetcher] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading from splits [sp.us_channel_user:17] [1023880025205637138] 2025-09-26 16:55:01,243 INFO [a.s.c.s.c.s.r.SourceReaderBase] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Finished reading split(s) [sp.us_channel_user:17] [1023880025205637138] 2025-09-26 16:55:15,458 INFO [.b.s.r.IncrementalSourceReader] [hz.main.generic-operation.thread-36] - subtask 0 add splits: incremental-split-0 [1023880025205637138] 2025-09-26 16:55:15,463 INFO [r.IncrementalSourceSplitReader] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - It's turn to read incremental split, close current snapshot fetcher. [1023880025205637138] 2025-09-26 16:55:15,482 INFO [i.d.j.JdbcConnection ] [pool-52-thread-1] - Connection gracefully closed [1023880025205637138] 2025-09-26 16:55:15,485 INFO [o.a.k.c.j.JsonConverterConfig ] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - JsonConverterConfig values: converter.type = value decimal.format = BASE64 schemas.cache.size = 1000 schemas.enable = true [1023880025205637138] 2025-09-26 16:55:15,487 WARN [i.d.c.m.MySqlConnection ] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Database configuration option 'serverTimezone' is set but is obsolete, please use 'connectionTimeZone' instead [1023880025205637138] 2025-09-26 16:55:15,489 INFO [r.IncrementalSourceSplitReader] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Stream fetcher is created. [1023880025205637138] 2025-09-26 16:55:15,523 INFO [.f.MySqlSourceFetchTaskContext] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Merging server GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14422006 with restored GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420564 [1023880025205637138] 2025-09-26 16:55:15,526 INFO [.f.MySqlSourceFetchTaskContext] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Merged GTID set is b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420564 [1023880025205637138] 2025-09-26 16:55:15,526 INFO [.f.MySqlSourceFetchTaskContext] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - MySQL current GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14422006 does contain the GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420564 required by the connector. [1023880025205637138] 2025-09-26 16:55:15,531 INFO [.f.MySqlSourceFetchTaskContext] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Server has already purged GTIDs [1023880025205637138] 2025-09-26 16:55:15,533 INFO [.f.MySqlSourceFetchTaskContext] [Source Data Fetcher for BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:14420565-14422006 known by the server but not processed yet, for replication are available only GTID set b7a00add-2d5d-11eb-9559-00163e5d40aa:14420565-14422006 [1023880025205637138] 2025-09-26 16:55:15,540 INFO [IncrementalSourceStreamFetcher] [debezium-reader-0] - Start incremental read task for incremental split: IncrementalSplit(tableIds=[sp.us_channel_user], startupOffset={ts_sec=0, file=mysql-maindb.001652, pos=429231352, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420564, row=0, event=0}, stopOffset={ts_sec=0, file=, pos=-9223372036854775808, row=0, event=0}, completedSnapshotSplitInfos=[org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@28855cb8, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@2642b7d8, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@227d37c8, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@677fbde3, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@659d4d28, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@5652da34, org .apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@1d5a7441, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@75042ac, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@8abab63, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@48684338, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@65ede08, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@31eb94d, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@563bfafe, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@5cc01282, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@2c9e298c, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@5abc3983, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@5359d420, org .apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@f5188cb, org.apache.seatunnel.connectors.cdc.base.source.split.CompletedSnapshotSplitInfo@52de12e4], checkpointDataType=null, checkpointTables=null, historyTableChanges=null) exactly-once: false [1023880025205637138] 2025-09-26 16:55:15,553 INFO [i.d.u.Threads ] [debezium-reader-0] - Requested thread factory for connector MySqlConnector, id = mysql_binlog_source named = binlog-client [1023880025205637138] 2025-09-26 16:55:15,582 INFO [i.d.u.Threads ] [debezium-reader-0] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client [1023880025205637138] 2025-09-26 16:55:15,588 INFO [i.d.u.Threads ] [blc-maindb.inter.wcansoft.com:3306] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client Sep 26, 2025 4:55:15 PM com.github.shyiko.mysql.binlog.BinaryLogClient connect INFO: Connected to maindb.inter.wcansoft.com:3306 at b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14420564 (sid:5652, cid:504996) [1023880025205637138] 2025-09-26 16:55:15,605 INFO [i.d.j.JdbcConnection ] [pool-54-thread-1] - Connection gracefully closed [1023880025205637138] 2025-09-26 16:55:15,605 INFO [m.s.r.f.b.MySqlBinlogFetchTask] [blc-maindb.inter.wcansoft.com:3306] - Binlog client connected, closed idle jdbc connection. [1023880025205637138] 2025-09-26 16:55:15,608 INFO [i.d.u.Threads ] [blc-maindb.inter.wcansoft.com:3306] - Creating thread debezium-mysqlconnector-mysql_binlog_source-binlog-client [1023880025205637138] 2025-09-26 16:55:21,077 INFO [IncrementalSourceRecordEmitter] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - The current record position {transaction_id=null, file=mysql-maindb.001652, pos=430234796, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14422045, server_id=9101} is after the maxSnapshotSplitsHighWatermark {ts_sec=0, file=mysql-maindb.001652, pos=430005933, gtids=b7a00add-2d5d-11eb-9559-00163e5d40aa:1-14421786, row=0, event=0}, mark enter pure increment phase. [1023880025205637138] 2025-09-26 16:55:21,077 INFO [IncrementalSourceRecordEmitter] [BlockingWorker-TaskGroupLocation{jobId=1023880025205637138, pipelineId=1, taskGroupId=2}] - Clean the IncrementalSplit#completedSnapshotSplitInfos to empty. [1023880025205637138] 2025-09-26 17:02:45,422 INFO [o.a.k.c.NetworkClient ] [kafka-producer-network-thread | producer-1] - [Producer clientId=producer-1] Node -1 disconnected. [1023880025205637138] 2025-09-26 17:02:45,426 INFO [o.a.k.c.NetworkClient ] [kafka-producer-network-thread | producer-1] - [Producer clientId=producer-1] Node -3 disconnected. ``` ### Zeta or Flink or Spark Version zeta 2.3.11 ### Java or Scala Version jdk8 ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
