ThorneANN opened a new pull request, #4245: URL: https://github.com/apache/flink-cdc/pull/4245
This commit implements the binlog-only newly added table capture feature for MySQL CDC DataStream connector, allowing dynamic table discovery without snapshot phase. Key changes: - Add new config option 'scan.binlog.newly-added-table.enabled' in MySqlSourceOptions - Add scanBinlogNewlyAddedTableEnabled field and getter in MySqlSourceConfig - Implement table pattern conversion from Flink CDC style to Debezium style in MySqlSourceConfigFactory - Add validation logic to ensure binlog-only mode works only with stream-only startup modes - Enhance BinlogSplitReader to auto-capture newly added tables matching the pattern - Add logging in MySqlSnapshotSplitAssigner for binlog-only mode - Expose scanBinlogNewlyAddedTableEnabled() API in MySqlSourceBuilder The feature converts table patterns (e.g., "db.table_\.*") to Debezium regex style (e.g., "db\.table_.*") and enables dynamic table discovery during binlog reading phase without triggering snapshots. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
