GitHub user xuanyuanking opened a pull request:
https://github.com/apache/spark/pull/19287
[SPARK-22074][Core] Task killed by other attempt task should not be
resubmitted
## What changes were proposed in this pull request?
As the detail scenario described in
[SPARK-22074](https://issues.apache.org/jira/browse/SPARK-22074), unnecessary
resubmitted may cause stage hanging in currently release versions. This patch
add a new var in TaskInfo to mark this task killed by other attempt or not.
## How was this patch tested?
Add a new UT `[SPARK-22074] Task killed by other attempt task should not be
resubmitted` in TaskSetManagerSuite, this UT recreate the scenario in JIRA
description, it failed without the changes in this PR and passed conversely.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xuanyuanking/spark SPARK-22074
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19287.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19287
----
commit a28daa2c3283ad31659f840e6d401ab48a42ad88
Author: Yuanjian Li <[email protected]>
Date: 2017-09-20T05:35:35Z
[SPARK-22074][Core] Task killed by other attempt task should not be
resubmitted
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
