Hi!

How coupled to Paimon catalogs and tables is the cdc part of Paimon?
RichCdcMultiplexRecord
<https://github.com/apache/paimon/blob/cc7d308d166a945d8d498231ed8e2fc9c7a27fc5/paimon-flink/paimon-flink-cdc/src/main/java/org/apache/paimon/flink/sink/cdc/RichCdcMultiplexRecord.java>
and related code seem incredibly useful even outside of the context of the
Paimon table format.

I'm asking because the database sync action
<https://paimon.apache.org/docs/master/flink/cdc-ingestion/mysql-cdc/#synchronizing-databases>
feature
is amazing.  At the Wikimedia Foundation, we are on an all-in journey with
Iceberg.  I'm wondering how hard it would be to extract the CDC logic from
Paimon and abstract the Sink bits.

Could the table/database sync with schema evolution (without Flink job
restarts!) potentially work with the Iceberg sink?

Thanks!
-Andrew Otto
 Wikimedia Foundation

Reply via email to