Github user jerryshao commented on a diff in the pull request:
https://github.com/apache/spark/pull/19580#discussion_r147303973
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -678,7 +679,9 @@ private[spark] class ExecutorAllocationManager(
val executorId = taskStart.taskInfo.executorId
allocationManager.synchronized {
- numRunningTasks += 1
+ if (stageIdToNumRunningTask.contains(stageId)) {
+ stageIdToNumRunningTask(stageId) =
stageIdToNumRunningTask(stageId) + 1
--- End diff --
nit: this can be changed to `stageIdToNumRunningTask(stageId) += 1`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
