Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/21068#discussion_r185533750
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala
---
@@ -102,18 +102,14 @@ private[yarn] class YarnAllocator(
private var executorIdCounter: Int =
driverRef.askSync[Int](RetrieveLastAllocatedExecutorId)
- // Queue to store the timestamp of failed executors
- private val failedExecutorsTimeStamps = new Queue[Long]()
+ private[spark] val failureTracker = new FailureTracker(sparkConf)
--- End diff --
I think you can move `FailureTracker` entirely within
`YarnAllocatorBlacklistTracker`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
