tgravescs commented on a change in pull request #27636:
[SPARK-30873][CORE][YARN]Handling Node Decommissioning for Yarn cluster manger
in Spark
URL: https://github.com/apache/spark/pull/27636#discussion_r389714038
##########
File path: core/src/main/scala/org/apache/spark/scheduler/Stage.scala
##########
@@ -91,8 +91,15 @@ private[scheduler] abstract class Stage(
*/
val failedAttemptIds = new HashSet[Int]
+ /**
+ * Number of times the stage failure needs to be ignored. e.g failed due to
fetch failed
Review comment:
I think comment needs updating, this is the number of times it was ignored
(not needs to be ignored).
Also I think we should rename to have Decommissioned in the name of it.
Although I'm not sure we really know that.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
