Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19580#discussion_r147289166
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -787,7 +791,9 @@ private[spark] class ExecutorAllocationManager(
/**
* The number of tasks currently running across all stages.
*/
- def totalRunningTasks(): Int = numRunningTasks
+ def totalRunningTasks(): Int = {
+ stageIdToNumRunningTask.values.sum
--- End diff --
Nevermind, this is called from a synchronized context. Except in your unit
tests, that is (which call the private`totalRunningTasks` you added to the
manager).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
