DanielLeens opened a new pull request, #10859:
URL: https://github.com/apache/seatunnel/pull/10859

   ## Summary
   - skip add-back for snapshot splits that are already finished and 
checkpointed in enumerator state
   - preserve checkpointed completion state so snapshot phase can advance to 
incremental phase after restore
   - add focused tests for completed+checkpointed vs 
finished-but-uncheckpointed snapshot split restore paths
   
   ## Background
   During CDC snapshot failover, `SnapshotSplitAssigner#addSplits` can 
re-enqueue a snapshot split that has already finished reading and whose 
completion watermark has already been checkpointed. That can keep the snapshot 
phase from completing and block the job from entering incremental reading.
   
   ## Verification
   - `./mvnw -pl seatunnel-connectors-v2/connector-cdc/connector-cdc-base -am 
-nsu -Dgit.skip=true -Dmaven.gitcommitid.skip=true spotless:apply`
   - attempted targeted tests for 
`SnapshotSplitAssignerTest,HybridSplitAssignerTest`, but the clean `dev` 
checkout currently hits unrelated compile failures before those tests can 
complete


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to