cshuo commented on issue #20038: URL: https://github.com/apache/hudi/issues/20038#issuecomment-5810107043
> The Coordinator should use the attemptId to clean up bootstrap and write events left by previous attempts. It should process and commit the restored write metadata only after receiving bootstrap events with the same attemptId from all subtasks. This approach would not work for partial failover in append write mode. Only a subset of subtasks may restart and increment their attemptId; unaffected subtasks retain their existing attempt IDs and do not resend bootstrap events. Waiting for bootstrap events with the same attemptId from all subtasks could therefore block indefinitely. We need an approach that also handles partial failover correctly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
