Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19580#discussion_r147291760
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -787,7 +791,9 @@ private[spark] class ExecutorAllocationManager(
/**
* The number of tasks currently running across all stages.
*/
- def totalRunningTasks(): Int = numRunningTasks
+ def totalRunningTasks(): Int = {
+ stageIdToNumRunningTask.values.sum
--- End diff --
It'd be nice to make the other method calling this synchronized, just to be
paranoid.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
