davidzollo opened a new issue, #11046:
URL: https://github.com/apache/seatunnel/issues/11046

   ## Background
   Some downstream systems do not want hard deletes from CDC streams. Instead, 
they need delete events to be converted into regular rows with an operation 
marker so records can be retained and filtered later.
   
   SeaTunnel currently lacks a dedicated CDC-side soft-delete conversion step.
   
   ## Proposed change
   Add a CDC transform/converter option that converts delete events into 
insert-like records while preserving an operation indicator for downstream 
processing.
   
   ## Expected behavior
   - Delete events can be transformed into retained rows for sinks that 
implement soft-delete semantics.
   - The transformed rows still expose enough metadata to distinguish original 
event type.
   - The behavior is opt-in and backward compatible.
   
   ## Acceptance criteria
   - Users can enable soft-delete conversion explicitly in a CDC transform path.
   - Converted rows retain an operation marker that downstream jobs can read.
   - English and Chinese docs are updated with an end-to-end example.
   - Add focused tests covering delete-event conversion behavior.
   
   ## Out of scope
   - New route evaluation modes.
   - General sink-side deduplication.
   - Automatic table creation options.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to