SEZ9 commented on issue #13224:
URL: https://github.com/apache/seatunnel/issues/13224#issuecomment-6820403100

   Thanks for filing the agreed follow-ups from #12440. Suggest splitting this 
into two PRs: (1) connector-owned commit stats in HudiCommitInfo, (2) 
fault-injection E2E. Each can be reviewed and merged independently.
   
   For item 1, please include a test with the Hudi metadata table enabled (the 
configuration that tracks records) and note whether the checkpoint state format 
change requires a state version bump / migration for jobs restoring from a 
checkpoint written by the current WriteStatus-based format.
   
   For item 2, consider reusing the existing fault-injection patterns in 
seatunnel-e2e (e.g. a sink that throws after a configured number of 
checkpoints, or killing the TaskExecution via the engine API) and assert 
exactly-once by comparing committed record count against the source after 
restore, including a check that no orphaned requested/inflight instants remain 
on the timeline.
   
   <!-- streview-comment:2300 -->


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to