lvyanquan opened a new pull request, #4626: URL: https://github.com/apache/flink-cdc/pull/4626
## What is the purpose of this pull request? Fix FLINK-41485: propagate MySQL column reordering so downstream schemas stay aligned with the layout of subsequent records. Ignoring `MODIFY COLUMN` / `CHANGE COLUMN` with `FIRST` or `AFTER` can otherwise silently assign values to the wrong fields. JIRA: https://issues.apache.org/jira/browse/FLINK-41485 ## Brief change log - Add validated column-move events, schema application and serialization. Preserve existing event identifiers and the legacy add-column API/wire format. - Emit reordering events in DDL order, including compound changes, rename/type changes and case normalization. - Support synchronous and asynchronous transforms, computed columns, routing, and record remapping when reordering is excluded, lenient or unsupported in tolerant mode. - Update Kafka/Values schemas and physically reorder Paimon/StarRocks columns. Preserve column definitions and enforce StarRocks key-order constraints; explicitly reject unsupported moves in Doris, Fluss, Iceberg, MaxCompute and OceanBase. - Document configuration and sink behavior in English and Chinese. ## Verifying this change - 194 targeted tests passed with Flink 1.20.3 / Java 11, and the same 194 tests passed with Flink 2.2.0 / Java 17. - Kafka JSON regression tests verify that same-type `name` / `city` fields retain their values after reordering. - Regression proof: restoring the master MySQL parser makes 8 of the 10 parser tests fail; restoring the fix makes all 10 pass. - Added MySQL-to-Values / MySQL-to-Kafka end-to-end coverage and StarRocks integration coverage. E2E sources compile under Flink 1.20.3 / Java 11; Docker-backed integration and E2E cases have **not** been executed locally. - Spotless and Checkstyle passed for core, CLI and affected connector modules; the E2E module also passed Spotless. GitHub CI has not run yet. ## Documentation - Does this pull request introduce a new feature? **Yes**, column-reordering events and their pipeline handling. - How is the feature documented? **Docs and JavaDocs**, including English and Chinese schema-evolution documentation. --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Codex CLI 0.163.0-alpha.10.2 Generated-by: Codex CLI 0.163.0-alpha.10.2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
