cshuo commented on issue #19922: URL: https://github.com/apache/hudi/issues/19922#issuecomment-5658577742
Thanks for the detailed report. The failure path looks valid: scale-up can leave the restored bootstrap buffer incomplete under checkpointId = -1, and new writes reuse that mapping without initializing the coordinator’s instant. The original initialization logic assumes restored pending events are recommitted before the new job starts writing from -1. Using restoredCheckpointId avoids this collision, but we should also verify that the pending instant is eventually committed and recovery preserves all records. This is closely related to [#15309](https://github.com/apache/hudi/issues/15309) and [#6273](https://github.com/apache/hudi/pull/6273), which discuss missed recommits after changing write parallelism. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
