Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/18070
sorry the case I was talking about is with a fetch failure. The true abort
stage doesn't happen until it retries 4 times. in that mean time you can have
tasks from the same stage (different attempts) running at the same time because
we currently don't kill the tasks from the aborted stage. Although thinking
about that more having them show up as killed doesn't hurt anything just making
a bit bigger assumption.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
