AngersZhuuuu commented on issue #26206: [SPARK-29551][CORE] Fix a bug about fetch failed when an executor is lost URL: https://github.com/apache/spark/pull/26206#issuecomment-546299290 Seems got your point, for fetch fail, you want it don't remove executor, if remove it, we need to re compute stage. In you pr, you allow it retry in task level, not just remove executor. But what confused me is that, fetch data have retry mechanism ，we have add some pr to fix fetch failed problem in lower level such as : https://github.com/apache/spark/pull/24533 https://github.com/apache/spark/pull/25469 https://github.com/apache/spark/pull/23590 Do we need to do that in this place.?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
