Ngone51 commented on a change in pull request #24704: [SPARK-20286][core] Improve logic for timing out executors in dynamic allocation. URL: https://github.com/apache/spark/pull/24704#discussion_r287634570
########## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ########## @@ -142,30 +137,22 @@ private[spark] class ExecutorAllocationManager( // Executors that have been requested to be removed but have not been killed yet private val executorsPendingToRemove = new mutable.HashSet[String] Review comment: Is it possible also moving this into `ExecutorMonitor` ? So that `ExecutorAllocationMonitor` would be more pure by removing `onExecutorRemoved` and `ExecutorMonitor` would be more knowledgeable about executor's state, including pending. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
