Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-22 Thread Yanquan Lv
Thanks jerry for driving this, JDBC sink for CDC pipeline is indeed a high demand in the community. I have one concern: Some databases that use jdbc, such as mysql, may be time-consuming to perform table structure changes, but FlinkCDC will not send DataChangeEvent during this period, which can

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-21 Thread Leonard Xu
Thanks Jerry for kicking off this thread, the idea makes sense to me, JDBC Sink is users’ need and Flink CDC project should support it soon. Could you share your design docs(FLIP) firstly[1]? And then we can continue the design discussion. Please feel free to ping me if you have any concerns

[DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-15 Thread Jerry
Hi all My name is ZhengjunZhou, an user and developer of FlinkCDC. In my recent projects, I realized that we could enhance the capabilities of Flink-CDC-Pipeline by introducing a JDBC Sink plugin, enabling FlinkCDC to directly output change data capture (CDC) to various JDBC-supported database