HuangZhenQiu opened a new issue, #18051: URL: https://github.com/apache/hudi/issues/18051
### Bug Description **What happened:** For Flink Hudi ingestion jobs configured restart strategy, if it failed after checkpoint complete before Hudi commit finish, the job will restart with completed checkpoint in which kafka offset already proceeded. **What you expected:** In this case, we should at least prevent job to do the internal restart and let the job fail directly. It gives platform to do the additional state check and make the checkpoint and hudi commit consistent before restarting the job. **Steps to reproduce:** 1. 2. 3. ### Environment **Hudi version:** **Query engine:** (Spark/Flink/Trino etc) **Relevant configs:** ### Logs and Stack Trace _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
