yuxiqian commented on code in PR #770: URL: https://github.com/apache/flink-web/pull/770#discussion_r1921708860
########## docs/content/posts/2025-01-18-release-cdc-3.3.0.md: ########## @@ -0,0 +1,79 @@ +--- +title: "Apache Flink CDC 3.3.0 Release Announcement" +date: "2025-01-18T08:00:00.000Z" +authors: +- ruanhang: + name: "Hang Ruan" +aliases: +- /news/2025/01/18/release-cdc-3.3.0.html +--- + +The Apache Flink Community is excited to announce the release of Flink CDC 3.3.0! +This release introduces more features in transform and connectors and improve +usability and stability of existing features. + +Flink CDC release packages are available at [Releases Page](https://flink.apache.org/downloads.html#flink-cdc), +and documentations are available at [Flink CDC documentation](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.3) page. +Looking forward to any feedback from the community through the Flink [mailing lists](https://flink.apache.org/community.html#mailing-lists) or [JIRA](https://issues.apache.org/jira/browse/flink)! + +# Highlights + +## Connectors + +### New Pipeline Connectors + +Flink CDC 3.3.0 introduces 2 new pipeline connector: + +* OceanBase sink +* MaxCompute sink + +### MySQL + +* Support parsing gh-ost generated schema changes. +* Parse array-typed key index binlog created between 8.0.17 and 8.0.18 rightly. +* Support passing op_ts to meta field in Event. +* Fixed deadlock after adding new tables. +* Fixed a bug that works with FLOAT type with precision + +### Apache Paimon + +* Apply default value options when apply add column change. +* Reuse sequence number when schema evolution happened. +* Fixed commit conflict problem in PaimonSink. +* Remove Catalog.ColumnAlreadyExistException when apply applyAddColumnEventWithPosition in paimon. + +### Postgres + +* Support metadata 'op_type' virtual column for Postgres CDC Connector. +* Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC. + +### Flink CDC Base + +* CDC framework split snapshot chunks asynchronously +* Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme +* Allow applying Truncate & Drop table to Doris/Paimon/Starrocks connectors +* The flink-cdc-base module supports source metric statistics +* Use fixed format for SnapshotSplit's splitId in all connectors +* Merge result of data type BIGINT and DOUBLE is DOUBLE instead of STRING + +## Upgrade Flink compatibility to 1.19+ + Review Comment: +1 for cdc-up utility. > CDC 3.3.0 comes with a `cdc-up` utility script to set up a data integration PoC pipeline and required environment easily. Follow the latest [quickstart steps](https://github.com/apache/flink-cdc#quickstart-guide) to get started. ########## docs/content/posts/2025-01-18-release-cdc-3.3.0.md: ########## @@ -0,0 +1,79 @@ +--- +title: "Apache Flink CDC 3.3.0 Release Announcement" +date: "2025-01-18T08:00:00.000Z" +authors: +- ruanhang: + name: "Hang Ruan" +aliases: +- /news/2025/01/18/release-cdc-3.3.0.html +--- + +The Apache Flink Community is excited to announce the release of Flink CDC 3.3.0! +This release introduces more features in transform and connectors and improve +usability and stability of existing features. + +Flink CDC release packages are available at [Releases Page](https://flink.apache.org/downloads.html#flink-cdc), +and documentations are available at [Flink CDC documentation](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.3) page. +Looking forward to any feedback from the community through the Flink [mailing lists](https://flink.apache.org/community.html#mailing-lists) or [JIRA](https://issues.apache.org/jira/browse/flink)! + +# Highlights + +## Connectors + +### New Pipeline Connectors + +Flink CDC 3.3.0 introduces 2 new pipeline connector: + +* OceanBase sink +* MaxCompute sink + +### MySQL + +* Support parsing gh-ost generated schema changes. +* Parse array-typed key index binlog created between 8.0.17 and 8.0.18 rightly. +* Support passing op_ts to meta field in Event. +* Fixed deadlock after adding new tables. +* Fixed a bug that works with FLOAT type with precision + +### Apache Paimon + +* Apply default value options when apply add column change. +* Reuse sequence number when schema evolution happened. +* Fixed commit conflict problem in PaimonSink. +* Remove Catalog.ColumnAlreadyExistException when apply applyAddColumnEventWithPosition in paimon. + +### Postgres + +* Support metadata 'op_type' virtual column for Postgres CDC Connector. +* Improve PostgresDialect.discoverDataCollections to reduce the start time of Postgres CDC. + +### Flink CDC Base + +* CDC framework split snapshot chunks asynchronously +* Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme +* Allow applying Truncate & Drop table to Doris/Paimon/Starrocks connectors +* The flink-cdc-base module supports source metric statistics +* Use fixed format for SnapshotSplit's splitId in all connectors +* Merge result of data type BIGINT and DOUBLE is DOUBLE instead of STRING + +## Upgrade Flink compatibility to 1.19+ + +Flink latest version have been updated to 1.20. Flink CDC version 3.3.0 will support Flink 1.19+ +and drop supports for Flink 1.17.* and 1.18.* . + +## Transform + +* Support TimestampDiff function. Review Comment: Timestamp adding function is included, too. Maybe we can put newly added built-in functions (`timestampdiff`, `timestampadd`, `unix_timestamp`) together -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
