lvyanquan opened a new pull request, #4626:
URL: https://github.com/apache/flink-cdc/pull/4626

   ## What is the purpose of this pull request?
   
   Fix FLINK-41485: propagate MySQL column reordering so downstream schemas 
stay aligned with the layout of subsequent records. Ignoring `MODIFY COLUMN` / 
`CHANGE COLUMN` with `FIRST` or `AFTER` can otherwise silently assign values to 
the wrong fields.
   
   JIRA: https://issues.apache.org/jira/browse/FLINK-41485
   
   ## Brief change log
   
   - Add validated column-move events, schema application and serialization. 
Preserve existing event identifiers and the legacy add-column API/wire format.
   - Emit reordering events in DDL order, including compound changes, 
rename/type changes and case normalization.
   - Support synchronous and asynchronous transforms, computed columns, 
routing, and record remapping when reordering is excluded, lenient or 
unsupported in tolerant mode.
   - Update Kafka/Values schemas and physically reorder Paimon/StarRocks 
columns. Preserve column definitions and enforce StarRocks key-order 
constraints; explicitly reject unsupported moves in Doris, Fluss, Iceberg, 
MaxCompute and OceanBase.
   - Document configuration and sink behavior in English and Chinese.
   
   ## Verifying this change
   
   - 194 targeted tests passed with Flink 1.20.3 / Java 11, and the same 194 
tests passed with Flink 2.2.0 / Java 17.
   - Kafka JSON regression tests verify that same-type `name` / `city` fields 
retain their values after reordering.
   - Regression proof: restoring the master MySQL parser makes 8 of the 10 
parser tests fail; restoring the fix makes all 10 pass.
   - Added MySQL-to-Values / MySQL-to-Kafka end-to-end coverage and StarRocks 
integration coverage. E2E sources compile under Flink 1.20.3 / Java 11; 
Docker-backed integration and E2E cases have **not** been executed locally.
   - Spotless and Checkstyle passed for core, CLI and affected connector 
modules; the E2E module also passed Spotless. GitHub CI has not run yet.
   
   ## Documentation
   
   - Does this pull request introduce a new feature? **Yes**, column-reordering 
events and their pipeline handling.
   - How is the feature documented? **Docs and JavaDocs**, including English 
and Chinese schema-evolution documentation.
   
   ---
   
   ##### Was generative AI tooling used to co-author this PR?
   
   - [X] Yes — Codex CLI 0.163.0-alpha.10.2
   
   Generated-by: Codex CLI 0.163.0-alpha.10.2
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to