zhangshenghang commented on issue #10203: URL: https://github.com/apache/seatunnel/issues/10203#issuecomment-3686605716
> [@zhangshenghang](https://github.com/zhangshenghang) sorry for the late reply. For this issue I’m planning to extend [IncrementalSourceEnumerator](https://github.com/apache/seatunnel/blob/dev/seatunnel-connectors-v2/connector-cdc/connector-cdc-base/src/main/java/org/apache/seatunnel/connectors/cdc/base/source/enumerator/IncrementalSourceEnumerator.java) and add a MySqlIncrementalSourceEnumerator that periodically discovers new tables (based on the existing regex config) and assigns splits for them. I’ll also add MySQL source options like discover-new-tables (or dynamic_table_discovery) and discovery-interval-ms to control whether this behavior is enabled and how often the discovery runs. What do you think about this direction? thanks @dongwooooooo , The interface should be more general. In the future, it will not only support MySQL but also other databases. Can you provide a detailed and complete plan? Then we can initiate a discussion on the mailing list. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
