zhangshenghang opened a new issue, #10203: URL: https://github.com/apache/seatunnel/issues/10203
### Search before asking - [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement. ### Description ### Search before asking - [x] I have searched the [issues](https://github.com/apache/seatunnel/issues) and found no similar feature request. ### Description When using the MySQL connector to synchronize multiple tables, we can configure a regex pattern to match table names (e.g. `test_.*`) so that multiple tables are synchronized in one job. However, currently the job only discovers and synchronizes the tables that exist at job startup. If new tables are created in the same database later and their names also match the configured regex pattern, these newly created tables are **not** automatically picked up and synchronized by the running job. ### Expected Behavior I would like SeaTunnel to support **dynamic discovery of new tables** for MySQL regex-based multi-table sync: - A job is configured with a regex pattern for tables (for example `test_.*`). - After the job has started, when a new table (e.g. `test_3`) is created in the same database and its name matches the configured pattern, the connector should: - Automatically discover this new table, and - Start reading/synchronizing data from this new table without restarting the job. This could be controlled by a new configuration option (for example `discover-new-tables` / `dynamic_table_discovery`), so users can enable or disable this behavior explicitly. ### Why is this needed? For scenarios where new tables are created frequently following the same naming convention (for example, sharded tables or time-partitioned tables), it is very inconvenient to modify the configuration and restart the job every time a new table is added. Dynamic table discovery would: - Reduce operational overhead. - Make SeaTunnel more suitable for large-scale, frequently-changing MySQL schemas. - Align with the expectation that a regex pattern should keep matching newly created tables as long as they satisfy the pattern. ### Additional context - Connector: MySQL (CDC / source used for syncing multiple tables with regex). - Behavior observed: only tables existing at job start are synchronized; newly created matching tables are ignored until the job is updated/restarted. Please let me know if there is already a way to enable this behavior in the current version, or if more information is needed. ### Usage Scenario _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
