Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/19534
Do you mean we may first set `numRunningTasks` to 0 and then run into
`onTaskEnd` and have `numRunningTasks -= 1`? Could we simply check
`stageIdToSpeculativeTaskIndices`/`stageIdToTaskIndices` to see whether the
stageId is still valid to avoid the issue?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
