Ngone51 edited a comment on pull request #32114: URL: https://github.com/apache/spark/pull/32114#issuecomment-899979045
I just realized this bug does cause the real problem when working in conjunction with https://github.com/apache/spark/pull/24533. Basically, the re-registration issue leads to the driver thinks an executor is alive while it's actually dead, which in turn causes the client to retry the block fetching on a dead executor, while it shouldn't. Could you @sumeetgajjar backport this fix to 3.1/3.0 as well? cc @mridulm @attilapiros -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
