morozov commented on PR #4087: URL: https://github.com/apache/flink-cdc/pull/4087#issuecomment-4095710471
https://github.com/apache/flink-cdc/blob/c4b698bffb692f480622123fec36494ec505929c/flink-cdc-connect/flink-cdc-source-connectors/flink-connector-mysql-cdc/src/main/java/org/apache/flink/cdc/connectors/mysql/debezium/reader/BinlogSplitReader.java#L291 If I'm reading the code correctly, if we cannot find the corresponding `matchedSplit`, it's `null`, so `BinlogSplitReader#shouldEmit()` will return `false`, which leads to data loss, not duplication. But this is a different issue ([FLINK-38270](https://issues.apache.org/jira/browse/FLINK-38270)). The principal differences are: 1. Here, the connection gets stuck not producing any data; there, it transitions to reading the binlog but drops data from tables. 2. This one is reproducible by addition of a table; the other one requires addition and removal during snapshot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
