Ngone51 commented on issue #22806: [SPARK-25250][CORE] : On successful completion of a task attempt on a parti… URL: https://github.com/apache/spark/pull/22806#issuecomment-451043233 > as far as killing running task attempts is concerned, that saves a lot of resources for long running tasks which might be consuming resources even though they have become redundant. I see. Another question: I know the `CommitDeniedException` is related to ResultStage, but from the desc of pr, is it possible that the same problem(I mean launching a redundant task for the already completed partition) happens on ShuffleMapStage ?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
