DanielLeens opened a new pull request, #11480:
URL: https://github.com/apache/seatunnel/pull/11480

   ## Purpose
   
   Add a runnable MySQL CDC to Elasticsearch scenario recipe covering data 
filtering, field normalization, metadata enrichment, derived fields, and 
primary-key upserts.
   
   ## Changes
   
   - add matching English and Chinese tutorials with plugin installation, MySQL 
CDC setup, source data, exact HOCON, job submission, Elasticsearch queries, and 
expected results
   - use an immutable primary-key range for CDC filtering and document why 
filtering mutable soft-delete/status fields before an upsert sink can leave 
stale Elasticsearch documents
   - add a Docker E2E test for snapshot filtering, phone normalization, 
metadata fields, status mapping, update handling, and incremental inserts
   - register the recipe in the scenario overview and sidebar
   
   ## Validation
   
   - `./mvnw spotless:apply -nsu -Dmaven.gitcommitid.skip=true`
   - `./mvnw -pl 
seatunnel-e2e/seatunnel-connector-v2-e2e/connector-elasticsearch-e2e 
-DskipTests test-compile -nsu -Dmaven.gitcommitid.skip=true`
   - `./mvnw -pl seatunnel-ci-tools -Dtest=MarkdownTest test -nsu 
-Dmaven.gitcommitid.skip=true`
   - verified that the HOCON blocks in both tutorials exactly match the 
submitted E2E resource
   - two independent pre-PR reviews passed after addressing tutorial and CDC 
semantic issues
   
   The Docker E2E test was intentionally not executed locally. The PR remains 
draft until the remote Docker E2E result is available.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to