Mrart opened a new issue, #3912: URL: https://github.com/apache/incubator-streampark/issues/3912
### Search before asking - [X] I had searched in the [SPIP](https://github.com/apache/incubator-streampark/issues?q=is%3Aissue+label%3A%22SPIP%22+) and found no similar SPIP. ### Motivation There are many internal business database systems, and the number and variety of upstream and downstream databases bring a lot of management difficulties. At the same time, most of the current business systems need to connect to Flink CDC for data synchronization. Flink itself supports metadata management, Streampark does not implement metadata management function at present, in order to improve the convenience of users to use data, we designed the metadata management function. ### Design Detail <img width="1436" alt="image" src="https://github.com/user-attachments/assets/e4385e60-96f4-4729-8cb5-bd72b7786b59";> <img width="492" alt="image" src="https://github.com/user-attachments/assets/0424e284-eb92-4967-9418-1cbf42905e4b";> flink-conf.yaml table.catalog-store.kind: jdbc table.catalog-store.jdbc.url: xxx1 table.catalog-store.jdbc.table-name: xxx2 table.catalog-store.jdbc.driver: xxx2 table.catalog-store.jdbc.username: xxx3 table.catalog-store.jdbc.password: xxx3 table.catalog-store.jdbc.max-retry-timeout:xxx4 db design: mysql sql ``` create table t_jdbc_catalog ( `id` bigint NOT NULL AUTO_INCREMENT, `catalog_name` varchar(255) NOT NULL, `configuration` JSON, `create_time` datetime DEFAULT NULL, `update_time` datetime DEFAULT NULL, PRIMARY KEY (`id`) USING BTREE, UNIQUE INDEX `uniq_catalog_name` (`catalog_name`) USING BTREE ) ``` pg sql ``` CREATE TABLE t_jdbc_catalog ( id BIGSERIAL PRIMARY KEY, catalog_name VARCHAR(255) NOT NULL, configuration JSONB, create_time TIMESTAMP DEFAULT NULL, update_time TIMESTAMP DEFAULT NULL, CONSTRAINT uniq_catalog_name UNIQUE (catalog_name) ); ``` db2 sql ``` CREATE TABLE t_jdbc_catalog ( id BIGINT GENERATED ALWAYS AS IDENTITY (START WITH 1 INCREMENT BY 1), catalog_name VARCHAR(255) NOT NULL, configuration JSON, create_time TIMESTAMP WITHOUT TIME ZONE DEFAULT NULL, update_time TIMESTAMP WITHOUT TIME ZONE DEFAULT NULL, CONSTRAINT uniq_catalog_name UNIQUE (catalog_name) ); ``` ### Compatibility, Deprecation, and Migration Plan _No response_ ### Test Plan _No response_ ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
