sd4324530 opened a new pull request, #4577: URL: https://github.com/apache/flink-cdc/pull/4577
## What is the purpose of this pull request? This PR upgrades the Paimon dependency of the paimon pipeline connector from `2.0.0` to the newly released `2.1.0` (released 2026-10-12, [release notes](https://github.com/apache/paimon/releases/tag/release-2.1.0)), tracked in FLINK-40994. Main motivations: - Correctness fixes that matter for CDC ingestion: fix silent data loss for deletion-vector rows (#8990), fix DELETE/UPDATE targeting wrong rows after Parquet predicate filtering (#8987), fix Flink sink coordinator commit recovery without intended failover (#8970) - Postpone-bucket improvements (automatic bucket-number estimation, postpone fixed-bucket write builder) and BLOB enhancements ## Brief change log - Bump `paimon.version` from `2.0.0` to `2.1.0` in `flink-cdc-pipeline-connector-paimon/pom.xml`, and in `flink-cdc-pipeline-e2e-tests/pom.xml` (the e2e module keeps its own property so the Paimon SQL connector jars copied into the test Flink cluster stay in sync) - Implement the new abstract method `StoreSinkWrite#write(InternalRow rowData, int bucket, int totalBuckets)` in the copied `StoreSinkWriteImpl`, introduced by Paimon 2.1.0 for postpone fixed-bucket writes Behavioral notes for reviewers (changes on the Paimon side; no action needed in this connector): - `CommitMessageSerializer` format version bumped 12 → 14: committables written by 2.0.0 remain deserializable (legacy path is preserved), so restoring from checkpoints/savepoints taken with 2.0.0 works; however, state written by 2.1.0 cannot be read after a downgrade - `postpone.default-bucket-num` no longer defaults to a fixed `1`; the bucket number for postpone tables is now estimated from target row count / file size ## Verifying this change This change is covered by existing tests: - All existing unit tests in `flink-cdc-pipeline-connector-paimon` pass (54/54) on JDK 11, for both Flink 1.20.3 (default) and Flink 2.2.0 (`-Pflink2`) - Existing integration tests pass on both profiles: `PaimonSinkITCase` (27/27), `AppendOnlyTableITCase` (2/2) - Manually verified the e2e pipeline `MySqlToPaimonE2eITCase` (Docker, Flink 1.20.3, parallelism 1 and 4): 4/4 passed ## Documentation - Does this pull request introduce a new feature? (yes / no): **no** (dependency upgrade only, no user-facing option changes) - If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented): **not applicable** --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes (please specify the tool below) Generated-by: CodeBuddy (GLM-5.3) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
